I mean I don’t believe most of the leadup-assumptions to this world in the first place.
But, AI would be way more competent at self-modification than billionaires. I think hopes that routes through: “build a aligned-ish medium strength AI, in a corrigibility basin”, then “ask it to help you make it more aligned” is the the sort of thing that might work if you actually succeed at the first step.
Just, you have to then progress quickly to fully aligned wise powerful longterm safeguards, which implies a degree of ‘fully solve alignment’ that it didn’t seem like everyone was properly imagining as necesssary.”
I mean I don’t believe most of the leadup-assumptions to this world in the first place.
But, AI would be way more competent at self-modification than billionaires. I think hopes that routes through: “build a aligned-ish medium strength AI, in a corrigibility basin”, then “ask it to help you make it more aligned” is the the sort of thing that might work if you actually succeed at the first step.
Just, you have to then progress quickly to fully aligned wise powerful longterm safeguards, which implies a degree of ‘fully solve alignment’ that it didn’t seem like everyone was properly imagining as necesssary.”