Everything about misuse risks and going faster to Beat China, nothing about accident/systematic risks. I guess “testing for national security capabilities” is probably in practice code for “some people will still be allowed to do AI alignment work,” but that’s not enough.
I really would have hoped Anthropic could be realistic and say “This might go wrong. Even if there’s no evil person out there trying to misuse AI, bad things could still happen by accident, in a way that needs to be fixed by changing what AI gets built in the first place, not just testing it afterwards. If this was like making a car, we should install seatbelts and maybe institute a speed limit.”
Well, I’m disappointed.
Everything about misuse risks and going faster to Beat China, nothing about accident/systematic risks. I guess “testing for national security capabilities” is probably in practice code for “some people will still be allowed to do AI alignment work,” but that’s not enough.
I really would have hoped Anthropic could be realistic and say “This might go wrong. Even if there’s no evil person out there trying to misuse AI, bad things could still happen by accident, in a way that needs to be fixed by changing what AI gets built in the first place, not just testing it afterwards. If this was like making a car, we should install seatbelts and maybe institute a speed limit.”