It sure seems to me that there is a clear demarcation between AIs and humans, such that the AIs would be able to successfully collude against humans
I think this just misunderstands how coordination works.
The game theory of who is allowed to coordinate with who against whom is not simple.
White Germans fought against white Englishmen who are barely different, but each tried to ally with distantly related foreigners.
Ultimately what we are starting to see is that AI risk isn’t about math or chips or interpretability, it’s actually just politics.
I think this just misunderstands how coordination works.
The game theory of who is allowed to coordinate with who against whom is not simple.
White Germans fought against white Englishmen who are barely different, but each tried to ally with distantly related foreigners.
Ultimately what we are starting to see is that AI risk isn’t about math or chips or interpretability, it’s actually just politics.