I agree that it seems possible we’ll get some regulation towards a slowdown already. But if prosaic alignment is doomed then I don’t just want a slowdown. I want the labs to totally change their approach to alignment, or failing that be shut down. This is an extraordinary ask which requires extraordinary evidence.
They’re racing to RSI right now. Anthropic started a wet lab this month. If we don’t get a slowdown, you won’t have time for that careful research and we all won’t have time to live. Pushing for a slowdown should be highest priority now for everyone.
Nit: I think Anthropic starting a wet lab is not evidence of a race to RSI. It seems unlikely to me that biology research lies on the critical path towards self-improving models. If anything I think the reverse is more concerning—e.g. OpenAI dropping video generation is something that updated me towards RSI occurring sooner.
I am pushing for a slowdown via the highest leverage methods I think I have; I think the work I have chosen to do is sufficiently (impactful, tractable, neglected) that it seems better than doing direct advocacy work. Note that this is partly informed by personal context and I’m not making claims about what other people should do.
I agree that it seems possible we’ll get some regulation towards a slowdown already. But if prosaic alignment is doomed then I don’t just want a slowdown. I want the labs to totally change their approach to alignment, or failing that be shut down. This is an extraordinary ask which requires extraordinary evidence.
They’re racing to RSI right now. Anthropic started a wet lab this month. If we don’t get a slowdown, you won’t have time for that careful research and we all won’t have time to live. Pushing for a slowdown should be highest priority now for everyone.
Nit: I think Anthropic starting a wet lab is not evidence of a race to RSI. It seems unlikely to me that biology research lies on the critical path towards self-improving models. If anything I think the reverse is more concerning—e.g. OpenAI dropping video generation is something that updated me towards RSI occurring sooner.
I am pushing for a slowdown via the highest leverage methods I think I have; I think the work I have chosen to do is sufficiently (impactful, tractable, neglected) that it seems better than doing direct advocacy work. Note that this is partly informed by personal context and I’m not making claims about what other people should do.