Not exactly—science fiction is usually set up so that humanity has a chance and that chance leads to victory, and part of Eliezer’s point is that victory is not at all guaranteed.
For a true UFAI, victory is guaranteed. For the AI. Otherwise it’s not actually “intelligent”, merely “somewhat smarter than a rock”—also an adequate description of humans.
No it is not. An AI does not have to be all-powerful. It might get beaten by a coordinated effort of humanity, or by another AI, or by an unlikely accident.
It’s theoretically possible to have an isolated AI that has no ability to affect the physical world, but that’s rather boring. Hollywood AI has enough power to produce dramatic tension, but is still weak enough to be defeated by plucky humans. In reality, pnce a UFAI gets to post-Judgement Day Skynet-level power, it’s over. Even putting aside the fact that it has freaking time machine, the idea of fighting a UFAI that has wiped out most of humanity in a nuclear holocaust and controls self-replicating, nigh indestructible robots is absurd.
It’s the staple of sci-fi.
Not exactly—science fiction is usually set up so that humanity has a chance and that chance leads to victory, and part of Eliezer’s point is that victory is not at all guaranteed.
For a true UFAI, victory is guaranteed. For the AI. Otherwise it’s not actually “intelligent”, merely “somewhat smarter than a rock”—also an adequate description of humans.
No it is not. An AI does not have to be all-powerful. It might get beaten by a coordinated effort of humanity, or by another AI, or by an unlikely accident.
It’s theoretically possible to have an isolated AI that has no ability to affect the physical world, but that’s rather boring. Hollywood AI has enough power to produce dramatic tension, but is still weak enough to be defeated by plucky humans. In reality, pnce a UFAI gets to post-Judgement Day Skynet-level power, it’s over. Even putting aside the fact that it has freaking time machine, the idea of fighting a UFAI that has wiped out most of humanity in a nuclear holocaust and controls self-replicating, nigh indestructible robots is absurd.