But we have to keep the humans around until humans are capable of engineering that world carefully and without screwing it up. If we don’t engineer it, who will?
Right. There are pretty good instrumental reasons for all the parties concerned to do that. Humans may also be useful for a while for rebooting the system—if there is a major setback. They have successfully booted things up once already. Other backup systems are likely to be less well tested.
But we have to keep the humans around until humans are capable of engineering that world carefully and without screwing it up. If we don’t engineer it, who will?
Right. There are pretty good instrumental reasons for all the parties concerned to do that. Humans may also be useful for a while for rebooting the system—if there is a major setback. They have successfully booted things up once already. Other backup systems are likely to be less well tested.