In fact, there ought to be a repository for scientific findings that have immediate political and sociological consequences.
A few years back, Aaron Swartz & Peter Eckersley tried this with a website called Science That Matters (now down), which revealed a couple of potential problems with this idea.
The first is pretty minor: the people running the repository might stop updating it after a while. STM got updated quite a lot through 2007, a couple of times in 2008, and never again after that.
The second is that scientific findings might not be as weighty as they sometimes look. They turn out to be wrong, get over-interpreted, get under-played, or prove less relevant than they first appear.
The last post on STM was titled “There is No Satisfactory Form of Utilitarianism”, based on a paper arguing that any sane way of aggregating the welfare of many into a single measure leads to at least one of “The Repugnant Conclusion”, “The Sadistic Conclusion”, and “The Very Anti-Egalitarian Conclusion”. This appears to force utilitarianism into an agonizing trilemma, as each of these three conclusions seems appalling. But the Repugnant Conclusion is arguably not so Repugnant after all, in which case the trilemma loses its force and the paper loses its urgency.
Another STM post discussed the RAND Health Insurance Experiment. The post first went one way, exaggerating the study’s results with the over-the-top title “Is the net effect of health care zero?”, and then swung the other way, warning readers in an update that JohnNyman highlighted a “terrible flaw” in the experiment that “would seem to severely throw these findings into question”. (Families given free healthcare were less likely to drop out of the experiment than families that had to pay some healthcare costs, introducing a bias.) Half a decade after Nyman, it turns out that some of the experiment’s results still stand after accounting for the flaw.
A similar issue crops up for the proposed lead-and-crime link you mention. Although the effect of high lead exposure on mortality and mental test performance is well established (quasi-)experimentally, the effect of low lead exposure on violent behaviour isn’t, so it’s not clear how much we should trust the quantitative estimates of the latter.
A few years back, Aaron Swartz & Peter Eckersley tried this with a website called Science That Matters (now down), which revealed a couple of potential problems with this idea.
The first is pretty minor: the people running the repository might stop updating it after a while. STM got updated quite a lot through 2007, a couple of times in 2008, and never again after that.
The second is that scientific findings might not be as weighty as they sometimes look. They turn out to be wrong, get over-interpreted, get under-played, or prove less relevant than they first appear.
The last post on STM was titled “There is No Satisfactory Form of Utilitarianism”, based on a paper arguing that any sane way of aggregating the welfare of many into a single measure leads to at least one of “The Repugnant Conclusion”, “The Sadistic Conclusion”, and “The Very Anti-Egalitarian Conclusion”. This appears to force utilitarianism into an agonizing trilemma, as each of these three conclusions seems appalling. But the Repugnant Conclusion is arguably not so Repugnant after all, in which case the trilemma loses its force and the paper loses its urgency.
Another STM post discussed the RAND Health Insurance Experiment. The post first went one way, exaggerating the study’s results with the over-the-top title “Is the net effect of health care zero?”, and then swung the other way, warning readers in an update that John Nyman highlighted a “terrible flaw” in the experiment that “would seem to severely throw these findings into question”. (Families given free healthcare were less likely to drop out of the experiment than families that had to pay some healthcare costs, introducing a bias.) Half a decade after Nyman, it turns out that some of the experiment’s results still stand after accounting for the flaw.
A similar issue crops up for the proposed lead-and-crime link you mention. Although the effect of high lead exposure on mortality and mental test performance is well established (quasi-)experimentally, the effect of low lead exposure on violent behaviour isn’t, so it’s not clear how much we should trust the quantitative estimates of the latter.