What I was getting at is that the current setup allows for side-channel methods of getting information on your opponent. (Digging to find their identity, reading their Facebook page, etc.).
While I accept that this interaction could be one of many between the AI and the researcher, this can be simulated in the anonymous case via a ‘I was previously GatekeeperXXX, I’m looking to resume a game with AIYYY’ declaration in the public channel while still preserving the player’s anonymity.
Prompted by Tuxedage learning to win, and various concerns about the current protocol, I have a plan to enable more AI-Box games whilst preserving the logs for public scrutiny.
See this: http://bæta.net/posts/anonymous-ai-box.html