Part of the deal of being allies if you don’t have to be allies about everything. I don’t think they particularly need to do anything to help with technical safety (there just need to be people who understand and care about that somewhere). I’m pretty happy if they’re just on board with “stop building AGI” for whatever reason.
I do think they eventually need to be on board with some version of the handling the intelligence curse (I didn’t know that term, here’s a link ), although I think in a lot of worlds the gameboard is so obviously changed I expect handling it to be an easier sell.
Part of the deal of being allies if you don’t have to be allies about everything.
That’s true, but for the alliance to be functional you need at least a moderate trust in the fact that whatever your shared interests are, they will persist for long enough that the other party won’t stab you in the back right away (until your entire goal is to just gain as much time as you can before the inevitable betrayal). I think most of these reasons are shallow or misaligned enough, and the crowd in question has shown itself so fickle and prone to simply valuing blind loyalty to its leader over any other overarching values, that an alliance isn’t worth what it costs.
I would be more trusting in general of an alliance with e.g. various religious leaders and factions. Even for all our differences, I would think that they would genuinely think about human dignity as a core principle. But a lot of these people quoted just sound annoyed about the fact that the LLMs aren’t siding with them on the culture war, and would sing another tune if they did.
I’m pretty happy if they’re just on board with “stop building AGI” for whatever reason.
Thank you for editing (sentence was cut short in earlier version). Reiterating what I said to @habryka with the same remark:
Even from a PauseAI standpoint (which isn’t my stance, but I do think global compute governance would be a good thing if achievable), I don’t see nationalists (some of which want the US to leave the United Nations) pushing for global compute governance with China. This is really only convincing from a specifically StopAI standpoint where you push for a national ban because you believe everyone regardless of {prior political beliefs,risk tolerance,likelihood of ending up as a winner post-intelligence-curse} will agree on stopping AGI and not taking part in an arms race if exposed to the right arguments, and expect people everywhere else on Earth will also push for a national ban in all their own countries without any coordination.
Part of the deal of being allies if you don’t have to be allies about everything. I don’t think they particularly need to do anything to help with technical safety (there just need to be people who understand and care about that somewhere). I’m pretty happy if they’re just on board with “stop building AGI” for whatever reason.
I do think they eventually need to be on board with some version of the handling the intelligence curse (I didn’t know that term, here’s a link ), although I think in a lot of worlds the gameboard is so obviously changed I expect handling it to be an easier sell.
That’s true, but for the alliance to be functional you need at least a moderate trust in the fact that whatever your shared interests are, they will persist for long enough that the other party won’t stab you in the back right away (until your entire goal is to just gain as much time as you can before the inevitable betrayal). I think most of these reasons are shallow or misaligned enough, and the crowd in question has shown itself so fickle and prone to simply valuing blind loyalty to its leader over any other overarching values, that an alliance isn’t worth what it costs.
I would be more trusting in general of an alliance with e.g. various religious leaders and factions. Even for all our differences, I would think that they would genuinely think about human dignity as a core principle. But a lot of these people quoted just sound annoyed about the fact that the LLMs aren’t siding with them on the culture war, and would sing another tune if they did.
Thank you for editing (sentence was cut short in earlier version). Reiterating what I said to @habryka with the same remark: