Science advances one funeral at a time
Major scientific institutions talk a big game about innovation, but the reality is that many of the mechanisms designed to ensure quality—peer review, funding decisions, the academic hierarchy—explicitly incentivize incremental rather than revolutionary progress; are far more oriented towards ‘day science’ than ‘night science.’[1]
Thomas Kuhn’s now-famous notion of paradigm shifts was pointing at precisely this phenomenon. When scientists work within what Kuhn called “normal science,” they’re essentially solving low- to medium-stakes puzzles within their field’s accepted framework. While it’s fairly easy to evaluate the relative quality of work that occurs within any given paradigm, Kuhn argued it’s nearly impossible for scientists to reason about the relative power of different paradigms for a given field—especially when they have already drank the paradigmatic kool-aid.
Max Planck captured this idea succinctly in his biting statement that “science advances one funeral at a time.”[2]
There is no shortage of examples of this occurring throughout the history of science:
Ignaz Semmelweis suggested that doctors wash their hands between patients. The medical establishment ridiculed and ostracized him until his career was destroyed. Today hand washing is basic medical practice.
Barbara McClintock discovered genes could jump between chromosomes in maize in 1948. Geneticists dismissed her work for decades as it didn’t fit their tidy theory of inheritance. She won the 1983 Nobel Prize for the same research they rejected.
Barry Marshall grew confident that ulcers came from bacteria, not stress. When no one would listen, he drank H. pylori in 1984 to prove it. Won the 2005 Nobel Prize for work doctors had called absurd.
Katalin Karikó lost her position and funding at UPenn in 1995 for pursuing mRNA research. She kept working on the “fringe” technology despite the setbacks. That same technology became the basis for the COVID-19 vaccines.
Alfred Wegener proposed continents move across the Earth. Geologists mocked him until his death in 1930. Plate tectonics became accepted theory in the 1950s when the evidence became overwhelming.
Lynn Margulis argued mitochondria evolved from ancient bacteria. Multiple journals rejected her paper before its 1967 publication. Her “crazy” theory is now the cornerstone of cell biology.
Dan Shechtman discovered quasicrystals in 1982 and was told by double Nobel laureate Linus Pauling “there are no quasi-crystals, only quasi-scientists.” They kicked him out of his research group. In 2011, he got his own Nobel Prize in Chemistry.
Ludwig Boltzmann argued matter was made of atoms when most physicists believed in continuous matter. The ridicule contributed to his suicide in 1906. His atomic theory became physics canon within years.
The takeaway here is quite relevant (and not all that unfamiliar) for alignment research. The still-young field attracts brilliant people who want to help solve the problem—and, by virtue of their technical chops, also care about their career capital. In attempting to check both of these boxes, many naturally gravitate toward “safer,” already-somewhat-established research areas. However, when we polled these very researchers, most acknowledged they don’t think these sorts of approaches will actually solve the core underlying problems in time. This seems quite familiar to the old story of incentives driving forward incremental work when what is desperately needed are breakthroughs.
The alignment innovations that will be most-critical-in-hindsight will have come from people who were willing to step outside the bounds, question the premises everyone took for granted, and pursue ideas that initially sounded ridiculous.
Got a crazy hunch that doesn’t fit nicely into the current alignment landscape? Come talk to us at EAG Boston—or apply to work on your idea with us here.
- ^
This is not to say that incremental progress is unimportant or that revolutionary progress is all that matters—only that mainstream science is mostly in the business of operating under established paradigms rather than creating new ones.
- ^
While this is the better-remembered variant, Planck’s actual statement was “a new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents die, and a new generation grows up that is familiar with it.” But this would have made for too long a title.
I’ve seen one paper arguing against Planck’s claim:
Interesting—this definitely suggests that Planck’s statement probably shouldn’t be taken literally/at face value if it is indeed true that some paradigm shifts have historically happened faster than generational turnover. It may still be possible that this may be measuring something slightly different than the initial ‘resistance phase’ that Planck was probably pointing at.
Two hesitations with the paper’s analysis:
(1) by only looking at successful paradigm shifts, there might be a bit of a survival bias at play here (we’re not hearing about the cases where a paradigm shift was successfully resisted and never came to fruition).
(2) even if senior scientists in a field may individually accept new theories, institutional barriers can still prevent that theory from getting adequate funding, attention, exploration. I do think Anthony’s comment below nicely captures how the institutional/sociological dynamics in science seemingly differ substantially from other domains (in the direction of disincentivizing ‘revolutionary’ exploration).
It’s neat to remember stories like this, but I want to note that this shouldn’t necessarily update scientists to criticize novel work less. If an immune system doesn’t sometimes overreact, it’s not doing its job right, and for every story like this there are multiple other stories of genuinely false exciting-sounding ideas that got shut down by experts (for instance I learned about Schekhtman from the Constant podcast, where his story was juxtaposed with that of genuine quacks). Looking back at my experience of excited claims that were generally dismissed by more skeptical experts in fields I was following, the majority of them (for instance the superluminal neutrino, the room-temperature superconductor, various hype about potentially proving the Riemann hypothesis by well-established mathematicians) have been false.
I think there is a separate phenomenon (which was the explanation for the study about funerals), that older high-status scientists in funding-hungry fields will often continue to get funding and set priorities after they have stopped working on genuinely exciting stuff—whether because of age, because of age-related conservatism bias, or simply because their area of expertise has become too well-developed to generate new ideas. In my experience in math and physics, from inside the field, this phenomenon generally does not look like a consensus that only the established people know what’s going on (as in most of the stories here), but either conversely a quiet consensus that so-and-so famous person is starting to go crazy, or alternatively the normal disagreement between more conservative and more innovation-minded people about the value of a new idea. For example the most exciting development in my professional life as a mathematician was Jacob Lurie’s development of “higher category theory”, a revolution that allowed algebraists to seamlessly use tools from topology. There were many haters of this theory (many very young), but there was enough of a diffuse understanding that this is exciting and potentially revolutionary that his ideas did percolate and end up converting many of the haters (similarly with Grothendieck and schemes). Note that here I think math avoids the worst aspects of these dynamics because it doesn’t require funding and is less competitive.
The upshot here is that I think it’s valuable to try to resolve the issue of good ideas being shot down by traditionalists, but the solution might not be to “adopt lower standards for criticizing new / surprising ideas” but rather something more like pulling the rope sideways and looking for better standards that do better at separating promising innovation from hype.
I think the issue here is not so much the disagreement or criticism as it is the mockery and ostracism. Unlike in, say, venture capital, there’s much less opportunity in science for someone to try something different and exciting, get enough funding to see if it really works out, and then, if it doesn’t but you were doing a good enough job trying, still be part of the community and get funding to try something else. (Yes, I know it doesn’t always work that way in the startup community either, but I think the odds are much better than in science)
Thanks for this! Completely agree that there are Type I and II errors here and that we should be genuinely wary of both. Also agree with your conclusion that ‘pulling the rope sideways’ is strongly preferred to simply lowering our standards. The unconventional researcher-identification approach undertaken by the HHMI might be a good proof of concept for this kind of thing.
I am going to nit-pick on Wegener. His theory of continental drift is not plate tectonics, and he was wrong for pretty much all the reasons that other geologists and physicists of the time said he was wrong. Plate tectonics was able to explain Wegener crucial observation of the continents “fitting together” but with a different and plausible mechanism. His observation was an important and theory-driving anomaly. I remember a text book from 1960s examining both the strong evidence for continental matchup and the highly problematic issues with his idea of continent drift. An expanding earth was also postulated which fitted a lot of observation but would imply physical laws changed over long time periods. In short, it is a lot more nuanced. Similarly, Boltzmann’s ideas on atomic theory were widely accepted in chemistry though physics took longer. Again, physics had an alternative hypothesis and it needed an experiment to separate them that didnt happen till after Boltzmann’s death. I think there are similar nuances with Marshall and H Pyroli. The “heroic” lone scientist against the establishment may be an appealing narrative but in terms of how science actually makes progress, I think the nuances in these cases are important and more telling about the process.
I didn’t understand this—“their technical chops impose opportunity cost as they’re able to build very safe successful careers if they toe the line” would make sense, or they care about career capital independent of their technical chops would make sense. But here, the relation between technical chops and caring about career capital doesn’t come through clear.
The examples you provided don’t actually support the “one funeral at a time” narrative in your title. Take Barbara McClintock’s jumping genes or Barry Marshall’s H. pylori discovery—in both cases, many scientists changed their views based on compelling evidence while very much alive. There are plenty of other examples of this. For example, the acceptance of prions as disease agents, the role of microbiomes in health, dark energy, and mitochondria’s bacterial origins all show how consensus can shift rapidly once a sufficient amount of evidence has accumulated. Scientists change their minds all. the. time.
This is not to say that there are not fads or incorrect beliefs in science—of course there are. And sometimes it can takes years or decades for them to be overwhelmed. But the “funeral” framing in particular is not only historically inaccurate but also promotes a harmful view that death is necessary for progress. What we actually see in these examples is that scientific views change when sufficient evidence accumulates and a sufficient number of people are convinced, regardless of generational turnover. Suggesting we need scientists to die rather than be convinced by evidence is both incorrect and ethically fraught. I am saddened to see it here and therefore strong downvoted this post.
I think you might be taking the quotation a bit too literally—we are of course not literally advocating for the death of scientists, but rather highlighting that many of the largest historical scientific innovations have been systematically rejected by one’s contemporaries in their field.
Agree that scientists change their minds and can be convinced by sufficient evidence, especially within specific paradigms. I think the thornier problem that Kuhn and others have pointed out is that the introduction of new paradigms into a field are very challenging to evaluate for those who are already steeped in an existing paradigm, which tends to cause these people to reject, ridicule, etc those with strong intuitions for new paradigms, even when they demonstrate themselves in hindsight to be more powerful or explanatory than existing ones.