Do not get me started on Neutral-FairBot, which Cooperates if it can prove its opponent Cooperates, Defects if it can prove its opponent Defects, and therefore must both Cooperate and Defect against itself.
Is that the 5 and 10 problem where you can prove both that you’d take $5 and that you’d take $10?
It responds with the behavior matching that of the first proof it finds. The question of what it does given its own source code is a special case. There isn’t a divergence between proof and behavior because it does whatever the proof says.
Is that the 5 and 10 problem where you can prove both that you’d take $5 and that you’d take $10?
Looks like it’s different:
It responds with the behavior matching that of the first proof it finds. The question of what it does given its own source code is a special case. There isn’t a divergence between proof and behavior because it does whatever the proof says.