Yes. But because we’re discussing a scenario in which the world is ready to slow down or shut down AGI research, I’m assuming those steps have been crossed.
The biggest step IMO, “alignment is hard” doesn’t intervene between taking ASI seriously and thinking it could prevent you from dying of natural causes.
There are several intermediate steps in the argument from ASI to doom.
Yes. But because we’re discussing a scenario in which the world is ready to slow down or shut down AGI research, I’m assuming those steps have been crossed.
The biggest step IMO, “alignment is hard” doesn’t intervene between taking ASI seriously and thinking it could prevent you from dying of natural causes.