Campbell’s Law posits that a metric is used because it has historically correlated with a difficult-to-measure desirable property; but that it becomes deranged only when it is used to make decisions that the measured people care about.
Historically, better-educated students do well on standardized tests, when those tests don’t matter. But once you enact a test to discriminate amongst students for purposes those students care about (like getting into prestigious colleges), your measurement of academic achievement will be confounded by your measurement of test-taking skills.
Certainly. I think the same principle applies in many of the listed cases, though. Scientific publications in particular likely developed their current standards at least partially because in the past they filtered for genuinely revolutionary results.
One might as easily say that Campbell’s Law is a sub-principle of the observed phenomenon.
Campbell’s Law posits that a metric is used because it has historically correlated with a difficult-to-measure desirable property; but that it becomes deranged only when it is used to make decisions that the measured people care about.
Historically, better-educated students do well on standardized tests, when those tests don’t matter. But once you enact a test to discriminate amongst students for purposes those students care about (like getting into prestigious colleges), your measurement of academic achievement will be confounded by your measurement of test-taking skills.
Certainly. I think the same principle applies in many of the listed cases, though. Scientific publications in particular likely developed their current standards at least partially because in the past they filtered for genuinely revolutionary results.
One might as easily say that Campbell’s Law is a sub-principle of the observed phenomenon.