Noteably, Eliezer, Nate, and John don’t spend much of any of their time assessing research at all (at least recently) as far as I can tell.
Perhaps not specific research projects, but they’ve communicated a lot regarding their models of what types of research are good/bad. (See e. g. Eliezer’s list of lethalities, John’s Why Not Just… sequence, this post of Nate’s.)
I would assume this is because this doesn’t scale and their reviews are not, in any given instance, the ultimate deciding factor regarding what people do or what gets funded. Spending time evaluating specific research proposals is therefore cost-inefficient compared to reviewing general research trends/themes.
My current view is that more of the bottleneck in grantmaking is not having good stuff to fund
Because no entity that I know of is currently explicitly asking for proposals that Eliezer/Nate/John would fund. Why would people bother coming up with such proposals in these circumstances? The system explicitly doesn’t select for it.
I expect that if there were an actual explicit financial pressure to goodhart to their preferences, much more research proposals that successfully do so would be around.
Perhaps not specific research projects, but they’ve communicated a lot regarding their models of what types of research are good/bad. (See e. g. Eliezer’s list of lethalities, John’s Why Not Just… sequence, this post of Nate’s.)
I would assume this is because this doesn’t scale and their reviews are not, in any given instance, the ultimate deciding factor regarding what people do or what gets funded. Spending time evaluating specific research proposals is therefore cost-inefficient compared to reviewing general research trends/themes.
Because no entity that I know of is currently explicitly asking for proposals that Eliezer/Nate/John would fund. Why would people bother coming up with such proposals in these circumstances? The system explicitly doesn’t select for it.
I expect that if there were an actual explicit financial pressure to goodhart to their preferences, much more research proposals that successfully do so would be around.