RSS

Para­noid Debating

Para­noid De­bat­ing is a var­i­ant of The Au­mann Game where one player pur­pose­fully sub­verts the group es­ti­mate. Similar to The Au­mann Game, the ac­tivity con­sists of a group jointly pro­duc­ing a con­fi­dence in­ter­val for an un­known, but ver­ifi­able quan­tity, which is then scored for ac­cu­racy and cal­ibra­tion. One in­di­vi­d­ual is des­ig­nated the spokesper­son, who is re­spon­si­ble for choos­ing the fi­nal es­ti­mate. How­ever, be­fore the ac­tivity be­gins, one in­di­vi­d­ual is se­cretly as­signed the role of mis­lead­ing the other mem­bers. The de­ceiver is scored higher the worse the fi­nal es­ti­mate is.

The ac­tivity is in­tended to teach ac­cu­rate es­ti­mate, proper agree­ment tech­niques, and recog­ni­tion of de­cep­tion.

A typ­i­cal sub­ject for the game might be “How much maize is pro­duced in Mex­ico an­nu­ally?”.

Rules

Sim­plest variant

Ad­vo­cate var­i­ant, #1

Ad­vo­cate var­i­ant, #2

Vari­a­tion-by-ar­gu­ment variant

South­ern Cal­ifor­nia Var­i­ant #1

At the Fe­bru­ary 2011 South­ern Cal­ifor­nia LW Meetup we tried play­ing the game. For ques­tions we bought a game of Wits & Wagers (which has trivia ques­tions with nu­mer­i­cal an­swers) and looked at the cards to find ques­tions that were about sub­stan­tive top­ics where Fermi es­ti­mates seemed use­ful. The speaker/​ad­vo­cate was cho­sen on a ro­tat­ing ba­sis so that ev­ery­one gets at least one chance to play that role, and cards are dealt from a deck of play­ing cards to ev­ery­one else. Red cards mean you’re try­ing to make the group de­liver a bad an­swer. Black cards mean you’re try­ing to make the group de­liver a good an­swer. This makes the num­ber of peo­ple to be sus­pi­cious of it­self an un­known pa­ram­e­ter and leads to funny out­comes and in­ter­est­ing co­or­di­na­tion prob­lems. Scor­ing used the ex­per­i­men­tal scor­ing code that is in­tended to as­sign the most credit to small er­ror bars around high con­fi­dence cor­rect an­swers.

Questions

It’s re­ally easy to ask a ques­tion that is then very difficult to an­swer later. For ex­am­ple, the ques­tion “How many miles of railroad are there in Africa?” is some­what difficult to an­swer. Walk­ing through the CIA World Fact Book one coun­try at a time, we ar­rived at an an­swer in the range of 48,000-49,000. How­ever, in cross-check­ing that in­for­ma­tion, we dis­cov­ered that in Uganda, there are only 125 miles of ac­tive railroad, but 1200km listed in the Fact Book. It seems likely, there­fore, that the to­tal es­ti­mate in­cludes some non-ac­tive miles of railroad, and is thus too high. This sec­tion is here to list good and bad ques­tions and re­sources to get ques­tions from or an­swer ques­tions un­usu­ally eas­ily. If list­ing an an­swer, please make the text of the an­swer white so peo­ple can use it if they want.

Scoring

A not-so-triv­ial in­con­ve­nience to play­ing the game is figur­ing out how to score it prop­erly.

To make this eas­ier there is now a ten­ta­tive file for­mat for rep­re­sent­ing a game of para­noid de­bate and a python script for scor­ing games rep­re­sented in this for­mat. If you’d like to down­load or edit this soft­ware check out this github pro­ject. Please note that the game for­mat and the code are very likely to evolve to re­move bugs and sup­port what­ever sort of play turns out to be the most fun and/​or ed­u­ca­tional.

Blog posts

See also

No entries.
No comments.