This seems like a fun idea. I imagine there would be some high-level streamers willing to try this live (maybe chessbrah?).
What kind of lessons do you envision we learn from Deception Chess that could be applied towards alignment work? In my head, the situation is slightly different since we (or I) are currently assuming an AI tool isn’t actively trying to deceive us, but in Deception Chess it’s already known that there’s a malicious actor.
It’s a playground for testing ideas associated with Deception. Naturally there are other ways and other arenas. The rules for this arena are fun and flexible (perhaps no deceivers some of the time!), but still limited to discussing only the quality of particular chess moves in a specific positions. Quality as compared to a hidden but soon-revealed ‘perfect’ answer.
As far as lessons, I expect Player will have the most valuable post-game perspective. How easy is it to judge quality of Advice? In what ways does advice look different if it’s Deceptive? Does it even look different? Given a reasonably strong Opponent, most any human advice appears ‘Deceptive’ with no such intent.
This seems like a fun idea. I imagine there would be some high-level streamers willing to try this live (maybe chessbrah?).
What kind of lessons do you envision we learn from Deception Chess that could be applied towards alignment work? In my head, the situation is slightly different since we (or I) are currently assuming an AI tool isn’t actively trying to deceive us, but in Deception Chess it’s already known that there’s a malicious actor.
It’s a playground for testing ideas associated with Deception. Naturally there are other ways and other arenas. The rules for this arena are fun and flexible (perhaps no deceivers some of the time!), but still limited to discussing only the quality of particular chess moves in a specific positions. Quality as compared to a hidden but soon-revealed ‘perfect’ answer.
As far as lessons, I expect Player will have the most valuable post-game perspective. How easy is it to judge quality of Advice? In what ways does advice look different if it’s Deceptive? Does it even look different? Given a reasonably strong Opponent, most any human advice appears ‘Deceptive’ with no such intent.