Most people get the problem right when the numbers are stated as frequencies relative to some large number instead of probabilities or percentages, i.e., when the wording primes people to think about counting members in a class.
It’s still pretty scary that doctors would have to be primed to get basic statistical inference right (a skill that’s pretty essential to what they claim to do). The real world doesn’t hand you problems in neat, well-defined packages. You can guess the teacher’s password, but not Nature’s.
After I got into a warm discussion with some other members of the speech and debate club in high school, I started doing a little research into the field of medicine and its errors.
Long story short: doctors are not the experts most people (including many of them) believe them to be, our system of medicine is really screwed up, and it’s not even obvious that we derive a net benefit from medical intervention considered overall.
(It’s pretty obvious that some specific interventions are extremely important, but they’re quite basic and do not make up the majority of all interventions.)
A counterexample of my being right? Or a counterexample relating to medicine?
As in, “I have never encountered a doctor that actually understood the limits of his knowledge and how to appropriately use it, nor a clinical practice that wasn’t basically the blind leading the blind.”
Okay. I was unsure if your statement was meant to be a personal insult or a comment about medicine—your comments have cleared that up for me.
If I may offer a suggestion:
Access NewsBank from your local library, go to the “search America’s newspapers” option, and do some searching for the phrase “nasal radium”. There will be lots of duplication. You may find it useful to only search for articles written between 1990 and 1995, just to get a basic understanding of what it was.
Then realize that the vast majority of surgical treatments where introduced in pretty much the same way, and had the same amount of pre-testing, as nasal radium.
I don’t infer doctors’ actual performances from their responses to a word problem, so I’m not that scared. I don’t think byrnema was wrong to claim that
A doctor who frequently gives mammograms would certainly learn over time that most women who have a positive result don’t have breast cancer.
Er, the whole point of statistical inference (and intelligence more generally) is that you can get the most knowledge from the least data. In other words, so you can figure stuff out before learning it “the hard way”. If doctors “eventually figure out” that most positives don’t actually mean cancer, that means poor performance (judged against professionals in general), not good performance!
“Eventually” was byrnema’s usage—I’d bet doctors are probably told outright the positive and negative predictive values of the tests by the test designers.
It’s still pretty scary that doctors would have to be primed to get basic statistical inference right (a skill that’s pretty essential to what they claim to do). The real world doesn’t hand you problems in neat, well-defined packages. You can guess the teacher’s password, but not Nature’s.
After I got into a warm discussion with some other members of the speech and debate club in high school, I started doing a little research into the field of medicine and its errors.
Long story short: doctors are not the experts most people (including many of them) believe them to be, our system of medicine is really screwed up, and it’s not even obvious that we derive a net benefit from medical intervention considered overall.
(It’s pretty obvious that some specific interventions are extremely important, but they’re quite basic and do not make up the majority of all interventions.)
I was about to lecture you on how wrong you are, until I realized I’ve never encountered a counterexample.
Please note that I do not rule out the possibility that we derive a net benefit. It’s just that it isn’t obvious that we do.
A counterexample of my being right? Or a counterexample relating to medicine?
As in, “I have never encountered a doctor that actually understood the limits of his knowledge and how to appropriately use it, nor a clinical practice that wasn’t basically the blind leading the blind.”
Okay. I was unsure if your statement was meant to be a personal insult or a comment about medicine—your comments have cleared that up for me.
If I may offer a suggestion:
Access NewsBank from your local library, go to the “search America’s newspapers” option, and do some searching for the phrase “nasal radium”. There will be lots of duplication. You may find it useful to only search for articles written between 1990 and 1995, just to get a basic understanding of what it was.
Then realize that the vast majority of surgical treatments where introduced in pretty much the same way, and had the same amount of pre-testing, as nasal radium.
I don’t infer doctors’ actual performances from their responses to a word problem, so I’m not that scared. I don’t think byrnema was wrong to claim that
Er, the whole point of statistical inference (and intelligence more generally) is that you can get the most knowledge from the least data. In other words, so you can figure stuff out before learning it “the hard way”. If doctors “eventually figure out” that most positives don’t actually mean cancer, that means poor performance (judged against professionals in general), not good performance!
“Eventually” was byrnema’s usage—I’d bet doctors are probably told outright the positive and negative predictive values of the tests by the test designers.