One factor no one mentions here is the changing nature of our ability to coordinate at all. If our ability to coordinate in general is breaking down rapidly, which seems at least highly plausible, then that will likely carry over to AGI, and until that reverses it will continuously make coordination on AGI harder same as everything else.
In general, this post and the answers felt strangely non-”messy” in that sense, although there’s also something to be said for the abstract view.
In terms of inclusion, I think it’s a question that deserves more thought, but I didn’t feel like the answers here (in OP and below) were enlightening enough to merit inclusion.
One factor no one mentions here is the changing nature of our ability to coordinate at all. If our ability to coordinate in general is breaking down rapidly, which seems at least highly plausible, then that will likely carry over to AGI, and until that reverses it will continuously make coordination on AGI harder same as everything else.
In general, this post and the answers felt strangely non-”messy” in that sense, although there’s also something to be said for the abstract view.
In terms of inclusion, I think it’s a question that deserves more thought, but I didn’t feel like the answers here (in OP and below) were enlightening enough to merit inclusion.