On the current margin most safety research is several times more impactful as safety research than capabilities research. If publishing allows you to either stop wasting your time or get a job where you have access to 10x more resources, it’s a huge net win even if capabilities progress you generate removes 20% of your impact, which is unlikely. So I think this issue is way overblown.
On the current margin most safety research is several times more impactful as safety research than capabilities research. If publishing allows you to either stop wasting your time or get a job where you have access to 10x more resources, it’s a huge net win even if capabilities progress you generate removes 20% of your impact, which is unlikely. So I think this issue is way overblown.