Here’s maybe a related point: AIs might find it useful to develop an ability to reveal their internals in a verifiable way under certain conditions (say, when the other AI offers to do the same thing and there’s a way to do a secure “handshake”). So deception ability would be irrelevant, because AIs that can credibly refrain from deception with each other would choose to do so and get a first-best outcome, instead of second-best as voting theory would suggest.
A real world analogy is some of the nuclear precommitments mentioned in Schelling’s book. Like when the US and Soviets knowingly refrained from catching some of each other’s spies, because if a flock of geese triggers the warning radars or something, spies could provide their side with the crucial information that an attack isn’t really happening and there’s no need to retaliate.
Here’s maybe a related point: AIs might find it useful to develop an ability to reveal their internals in a verifiable way under certain conditions (say, when the other AI offers to do the same thing and there’s a way to do a secure “handshake”). So deception ability would be irrelevant, because AIs that can credibly refrain from deception with each other would choose to do so and get a first-best outcome, instead of second-best as voting theory would suggest.
A real world analogy is some of the nuclear precommitments mentioned in Schelling’s book. Like when the US and Soviets knowingly refrained from catching some of each other’s spies, because if a flock of geese triggers the warning radars or something, spies could provide their side with the crucial information that an attack isn’t really happening and there’s no need to retaliate.