What do you mean by automating catastrophe? Is it the creation of a misaligned AGI who has a chance to escape or to (create an ASI who will) fake alignment, be given the throne and commit genocide? Automating AI safety research would have us automate generating safety-related ideas, coding, gathering or creating data sets. But I don’t think that I understand how automated coding alone will cause a catastrophe.
What do you mean by automating catastrophe? Is it the creation of a misaligned AGI who has a chance to escape or to (create an ASI who will) fake alignment, be given the throne and commit genocide? Automating AI safety research would have us automate generating safety-related ideas, coding, gathering or creating data sets. But I don’t think that I understand how automated coding alone will cause a catastrophe.
Yes, but it wouldn’t be given the throne. It will take it (or rather, just obliterate it).