I think the main risk here is that it can continue scavenging existing tech for long enough to keep growing until it can bootstrap tech of its own. Still seems relatively risky for the AI compared to waiting till it’s self sufficient before destroying humanity.
Yeah, basically agree. When you have only a few ways of interacting with the world, you’re at the mercy of accidents until you can get redundancy—i.e. use a robot to build another robot out of scavenged parts. But ofc waiting longer until you’re self-sufficient also carries risks.
I think the main risk here is that it can continue scavenging existing tech for long enough to keep growing until it can bootstrap tech of its own. Still seems relatively risky for the AI compared to waiting till it’s self sufficient before destroying humanity.
The chances of this scenario grows in time as we will have more autonomous robots soon.
Also if there will be 10 or 1000 preserved robots, chances are also higher. 1000 robots could be found on a factory.
Yeah, basically agree. When you have only a few ways of interacting with the world, you’re at the mercy of accidents until you can get redundancy—i.e. use a robot to build another robot out of scavenged parts. But ofc waiting longer until you’re self-sufficient also carries risks.