IMO, one of the more plausible ways for us to survive without dignity is that we build somewhat-aligned AI smarter than us, they point out that going on to build ASI in a hurry is crazy, and they talk us into or otherwise enforce on us a pause.
Ugh, I was using LW’s custom reaction emoticons to annotate this comment, and through a fumble, have ended up expressing a confidence of 75% in the scenario that AI will “otherwise enforce on us a pause”, and I don’t see how to remove that annotation.
I will say that, alignment aside, the idea that an advanced AI will try to halt humanity’s AI research so it doesn’t produce a rival, makes a lot of sense to me.
If you hover your cursor over the react, you should see a popup showing one vote by you; from there, just click again on the highlighted upvote to remove.
(Mostly I’m making a play off reversing Eliezer’s concept of “death with dignity”.) Because we were foolish and survived only because AI saved us from the consequences of our foolishness, basically because it was in the blast zone too. Whereas in Eliezer’s scenario, we do something moderately wise, but not good enough and we die anyway.
IMO, one of the more plausible ways for us to survive without dignity is that we build somewhat-aligned AI smarter than us, they point out that going on to build ASI in a hurry is crazy, and they talk us into or otherwise enforce on us a pause.
Ugh, I was using LW’s custom reaction emoticons to annotate this comment, and through a fumble, have ended up expressing a confidence of 75% in the scenario that AI will “otherwise enforce on us a pause”, and I don’t see how to remove that annotation.I will say that, alignment aside, the idea that an advanced AI will try to halt humanity’s AI research so it doesn’t produce a rival, makes a lot of sense to me.
If you hover your cursor over the react, you should see a popup showing one vote by you; from there, just click again on the highlighted upvote to remove.
Why do you say this scenario is “without dignity”?
(Mostly I’m making a play off reversing Eliezer’s concept of “death with dignity”.) Because we were foolish and survived only because AI saved us from the consequences of our foolishness, basically because it was in the blast zone too. Whereas in Eliezer’s scenario, we do something moderately wise, but not good enough and we die anyway.