I worry the starting mental model is wrong. Ignore AI. Just think of weapons. You have various regimes. They are developing better and better weapons. You partition the regimes into groups where they can communicate and trust each other enough to collaboratively control their collective rate of weapons development. If you are in a trust cluster, you call that cluster your “allies” and every other regime or cluster is effective a potential enemy even if not directly involved in current threats or attacks.
The only solution is to delete all enemies. You can do this by eradicating them or by building trust/collaboration bridges.
The latter is probably quite complicated and is more the realm of markets, Legal Regime formation and monopolies of violence (Empire Building).
I would assume on LW a good subset of people understand the principles of stable regimes. Roughly the idea that given entities who are semi free to choose which regime they would like to inhabit or deal with, you end up choosing regimes along some Pareto curve of fair vs powerful. It should be obvious that you (an entity) prefer regimes that are more fair (to you at least) and are more powerful (to protect you). If a regime is powerful but unfair, another regime can “outbid” them by being more fair and possibly less strong. There might be a lot of interesting cases here but this is merely to show the gist of it.
I worry the starting mental model is wrong. Ignore AI. Just think of weapons. You have various regimes. They are developing better and better weapons. You partition the regimes into groups where they can communicate and trust each other enough to collaboratively control their collective rate of weapons development. If you are in a trust cluster, you call that cluster your “allies” and every other regime or cluster is effective a potential enemy even if not directly involved in current threats or attacks.
The only solution is to delete all enemies. You can do this by eradicating them or by building trust/collaboration bridges.
The latter is probably quite complicated and is more the realm of markets, Legal Regime formation and monopolies of violence (Empire Building).
I would assume on LW a good subset of people understand the principles of stable regimes. Roughly the idea that given entities who are semi free to choose which regime they would like to inhabit or deal with, you end up choosing regimes along some Pareto curve of fair vs powerful. It should be obvious that you (an entity) prefer regimes that are more fair (to you at least) and are more powerful (to protect you). If a regime is powerful but unfair, another regime can “outbid” them by being more fair and possibly less strong. There might be a lot of interesting cases here but this is merely to show the gist of it.