I support an AI halt (not a “pause”) … I fear AGI is reachable, the leap from AGI to ASI is short, and sufficiently robust ASI alignment is impossible in principle
This is grounds for a Pause to be potentially indefinite, which I think any Pause proponents should definitely allow as a possibility in principle. Just as you could be mistaken that ASI alignment is impossible in principle, in which case any Halt should end at some point, similarly people who believe ASI alignment is possible in principle could be mistaken, in which case any Pause should never end.
Conditions for ending a Pause should be about changed understanding of the problem, rather than expiration of an amount of time chosen in a poorly informed way (as the word “pause” might try to suggest). And the same kinds of conditions should have the power to end a Halt (unlike what the word “halt” suggests). I think this makes a sane Pause marginally less of a misnomer than a sane Halt (which should both amount to essentially the same thing as a matter of policy).
This is the stance of the PauseAI movement. “Pause” means stop AGI development immediately and resume if and only if we have high confidence that it is safe to do so, and there is democratic will to do so.
This is grounds for a Pause to be potentially indefinite, which I think any Pause proponents should definitely allow as a possibility in principle. Just as you could be mistaken that ASI alignment is impossible in principle, in which case any Halt should end at some point, similarly people who believe ASI alignment is possible in principle could be mistaken, in which case any Pause should never end.
Conditions for ending a Pause should be about changed understanding of the problem, rather than expiration of an amount of time chosen in a poorly informed way (as the word “pause” might try to suggest). And the same kinds of conditions should have the power to end a Halt (unlike what the word “halt” suggests). I think this makes a sane Pause marginally less of a misnomer than a sane Halt (which should both amount to essentially the same thing as a matter of policy).
This is the stance of the PauseAI movement. “Pause” means stop AGI development immediately and resume if and only if we have high confidence that it is safe to do so, and there is democratic will to do so.