I’m a bit conflicted on the subject of death penalty. I do agree with the view some solution is needed for incorrigible cases where you just don’t want that person out in general society. But I honestly don’t know if killing them versus imprisoning them for life is more or less humane. In terms of steelmanning the case I think one might explore this avenue. Which is the cruelest punishment?
But I would also say one needs to consider alternatives to either prison or death. Historically it was not unheard of to exile criminals to near impossible to escape locations—Australia possibly being a best example.
I’m reminded of the old Star Trek episode with the super humans that were found in cryosleep that then took over the Enterprise.
While I do agree that this could be one potential counter to AI (unless the relative speed things overwhelm) but also see a similar type of risk from the engineered humans. In that view, the program needs to be something that is widely implemented (which would also make it potentially a x-risk case itself) or we could easily find ourselves having created a ruler class that views ordinary humans as subhuman on not deserving of full rights. Not sure how that gets done though—from a purely practical and politically viable approach.
I certainly think if we’re doing things piecemeal we would want somewhat smarter people before we have much longer living people.