Too true.
Last year, I crammed seven AP tests (Calc BC, Env. Science, Psychology, Comp Sci A, Statistics, Biology, English Language) in two weeks. Got 5 in all but stat (A 4. I crammed this in eight hours the day before the test and started without even knowing what a binomial distribution was.). I knew the Calc and CS material cold, and I speak and write in decent English so maybe three were deserved. I had some knowledge of biology, and knew nothing about the other subjects apart from what trivia I had picked up on the net. And it’s not just the cutoffs. I was scoring near perfect scores in practice tests for many of these subjects (Multiple choice sections, the essays were harder to game). The problems are simply too darn easy for people with lots of background knowledge. Eliminating obviously wrong answers usually got me the right answer even if I didn’t know the material.
I suppose I’m an outlier and most people won’t be able to manage this, but I feel that something’s seriously broken with the tests when I score as qualified on semester or year-long courses after studying for maybe twenty hours at most on one subject.
I’m not sure how much of a problem this is though. Colleges are free to not accept AP tests, are they not?
At worst, cheaters like me will have a temporary advantage in admissions until everyone gets their act together. I suppose it could get worse if colleges didn’t act while the tests were being exploited to oblivion, but that points to deeper problems than just easy AP tests.
The problems are simply too darn easy for people with lots of background knowledge. Eliminating obviously wrong answers usually got me the right answer even if I didn’t know the material.
So, multiple choice questions are easier to hack than other kinds of questions, but if you “guess” the right answer 80% of the time, that’s not really guessing. I think you underestimate the degree to which lots of background knowledge implies lots of subject knowledge / how much autodidactic knowledge clever people pick up just by paying attention and being curious.
(My school didn’t offer Econ classes, but I took both AP Econ tests with about a day’s worth of prep with an exam book, and believe I got 5 on both of them. Not surprising for someone who read econ books for fun and argued about economics on the internet in his spare time!)
So, multiple choice questions are easier to hack than other kinds of questions, but if you “guess” the right answer 80% of the time, that’s not really guessing.
It depends how obvious it is that some of the answers are wrong.
It depends how obvious it is that some of the answers are wrong.
Obvious, of course, is a two-place word.
One experience I had that highlighted the importance of background knowledge for me was playing Alexei’s Calibration Game. I had literally no knowledge about the sports questions- after confirming that, I just clicked A every time, and had 50% accuracy. But one of the categories of questions was “which of these postmasters general of the US served first?”, which I was able to get 60-70% accuracy on, just by replacing that with the question “which of these two American names is more old-timey?”
I doubt a recent Chinese immigrant to the US would be able to hit 60% accuracy with that approach, because they don’t have that good a sense of what’s “old-timey” in the US. (And that’s with only two options!) I’ve seen a handful of prep tests for subjects I know very little about, and my guessing accuracy there is close to chance.
Another way to put this: with multiple choice tests, reversed stupidity is intelligence, and that’s a failing of the test. But identifying stupidity is a skill that requires some expertise.
Too true. Last year, I crammed seven AP tests (Calc BC, Env. Science, Psychology, Comp Sci A, Statistics, Biology, English Language) in two weeks. Got 5 in all but stat (A 4. I crammed this in eight hours the day before the test and started without even knowing what a binomial distribution was.). I knew the Calc and CS material cold, and I speak and write in decent English so maybe three were deserved. I had some knowledge of biology, and knew nothing about the other subjects apart from what trivia I had picked up on the net. And it’s not just the cutoffs. I was scoring near perfect scores in practice tests for many of these subjects (Multiple choice sections, the essays were harder to game). The problems are simply too darn easy for people with lots of background knowledge. Eliminating obviously wrong answers usually got me the right answer even if I didn’t know the material.
I suppose I’m an outlier and most people won’t be able to manage this, but I feel that something’s seriously broken with the tests when I score as qualified on semester or year-long courses after studying for maybe twenty hours at most on one subject.
I’m not sure how much of a problem this is though. Colleges are free to not accept AP tests, are they not? At worst, cheaters like me will have a temporary advantage in admissions until everyone gets their act together. I suppose it could get worse if colleges didn’t act while the tests were being exploited to oblivion, but that points to deeper problems than just easy AP tests.
So, multiple choice questions are easier to hack than other kinds of questions, but if you “guess” the right answer 80% of the time, that’s not really guessing. I think you underestimate the degree to which lots of background knowledge implies lots of subject knowledge / how much autodidactic knowledge clever people pick up just by paying attention and being curious.
(My school didn’t offer Econ classes, but I took both AP Econ tests with about a day’s worth of prep with an exam book, and believe I got 5 on both of them. Not surprising for someone who read econ books for fun and argued about economics on the internet in his spare time!)
It depends how obvious it is that some of the answers are wrong.
Obvious, of course, is a two-place word.
One experience I had that highlighted the importance of background knowledge for me was playing Alexei’s Calibration Game. I had literally no knowledge about the sports questions- after confirming that, I just clicked A every time, and had 50% accuracy. But one of the categories of questions was “which of these postmasters general of the US served first?”, which I was able to get 60-70% accuracy on, just by replacing that with the question “which of these two American names is more old-timey?”
I doubt a recent Chinese immigrant to the US would be able to hit 60% accuracy with that approach, because they don’t have that good a sense of what’s “old-timey” in the US. (And that’s with only two options!) I’ve seen a handful of prep tests for subjects I know very little about, and my guessing accuracy there is close to chance.
Another way to put this: with multiple choice tests, reversed stupidity is intelligence, and that’s a failing of the test. But identifying stupidity is a skill that requires some expertise.
But the expertise might not be in the area that’s ostensibly being tested.