I’ll just note that such a coalition could be formed even if the participants didn’t believe AGI would be too diffiicult to align. Even intent-aligned AGI is a terrifying risk to any nation in the hands of an opponent, or a rash or risky actor. So preventing proliferation makes sense, and a coalition helps do that.
We can hope that members of such a coalition will realize how difficult alignment is at some point before they create AGI.
My hope is that the US and China will act as the US and Russia did to prevent proliferation of nuclear weapon technology. Fighting each other to prevent AGI development is very risky, but it’s much less risky to keep it out of the hands of everyone else who’s further behind.
For each ones’ allies, this could be done by promising to share the beneficial technologies developed by AGI, and using it for defense from the opposite camp’s AGI and new technologies.
I’ll just note that such a coalition could be formed even if the participants didn’t believe AGI would be too diffiicult to align. Even intent-aligned AGI is a terrifying risk to any nation in the hands of an opponent, or a rash or risky actor. So preventing proliferation makes sense, and a coalition helps do that.
We can hope that members of such a coalition will realize how difficult alignment is at some point before they create AGI.
My hope is that the US and China will act as the US and Russia did to prevent proliferation of nuclear weapon technology. Fighting each other to prevent AGI development is very risky, but it’s much less risky to keep it out of the hands of everyone else who’s further behind.
For each ones’ allies, this could be done by promising to share the beneficial technologies developed by AGI, and using it for defense from the opposite camp’s AGI and new technologies.