My sense is at least Anthropic is aiming to make Claude into a moral sovereign which would be good to basically arbitrarily empower.
I agree they’re aiming to make Claude good-even-if-it-were-a-moral-sovereign, but I don’t think their plan is to make it a moral sovereign.
(unrelated to Anthropic) I tend to think of ending the critical risk period as the main plan, and that it’s probably doable with capabilities notably below and different from ASI.
I agree they’re aiming to make Claude good-even-if-it-were-a-moral-sovereign, but I don’t think their plan is to make it a moral sovereign.
(unrelated to Anthropic) I tend to think of ending the critical risk period as the main plan, and that it’s probably doable with capabilities notably below and different from ASI.