I have a worry about using trivia questions for calibration: there’s a substantial selection effect in the construction of trivia questions, so you’re much more likely to get an obscure question pointing to a well-known answer than happens by chance. The effect may be to calibrate people for trivia questions in a way that transfers poorly to other questions.
Thanks for providing this!
I have a worry about using trivia questions for calibration: there’s a substantial selection effect in the construction of trivia questions, so you’re much more likely to get an obscure question pointing to a well-known answer than happens by chance. The effect may be to calibrate people for trivia questions in a way that transfers poorly to other questions.