Concrete example: Someone you’re interviewing for a job flubs one question and your first thought is that your shouldn’t hire them, because people who aren’t qualified flub questions. But pause and ask how often you expect qualified people to miss one question in an hour long interview. Your answer will vary based on the kinds of questions your asking, but you may be treated the evidence as a stronger signal than it is.
Or maybe you treated it as a weaker signal than it is. This is a strawman anyway, people who never in their life heard of Bayes do compare it to their hypothetical idea of how a competent person would do on their exam, and soon thereafter, to their actual knowledge of how a competent person does, remedying all sorts of miscalibrations.
If anything, in practice the actual problem with interviews is generally that incompetents get through, because incompetents are being interviewed so much more than anyone else. Diligent ability to never flunk anything (conscientiousness) is, at least, something very useful in workplace that you can’t fake by preparing specifically for interviews.
Then there’s also this enormous utility disparity between the minor dis-utility of perhaps running the interviews for a little longer and ending up hiring the best when no one passes, and major dis-utility of hiring an incompetent.
It’s not really an advice, but I can see how its likeable—there’s people who didn’t get hired because they flunked “maybe one question”, and these folks will get a fix of their endorphins when they rationalize it as the HR person being irrational.
Or maybe you treated it as a weaker signal than it is. This is a strawman anyway, people who never in their life heard of Bayes do compare it to their hypothetical idea of how a competent person would do on their exam, and soon thereafter, to their actual knowledge of how a competent person does, remedying all sorts of miscalibrations.
If anything, in practice the actual problem with interviews is generally that incompetents get through, because incompetents are being interviewed so much more than anyone else. Diligent ability to never flunk anything (conscientiousness) is, at least, something very useful in workplace that you can’t fake by preparing specifically for interviews.
Then there’s also this enormous utility disparity between the minor dis-utility of perhaps running the interviews for a little longer and ending up hiring the best when no one passes, and major dis-utility of hiring an incompetent.
It’s not really an advice, but I can see how its likeable—there’s people who didn’t get hired because they flunked “maybe one question”, and these folks will get a fix of their endorphins when they rationalize it as the HR person being irrational.