I agree that it’s sad I got 22 upvotes; it was a cheap shot at an example I don’t think was really relevant. But here’s another cheap shot: if you learned a future history book would say “With the help of tens of trillions of nanobots, it would take more than 170 years for unfriendly superintelligences to eradicate the last pockets of human resistance beneath the crust of Ganymede”, would you follow that up with “See, I was right, it wasn’t such a big deal after all”?
I agree with all Aris Katsaris’ points as well, but, again, I don’t think this example is too relevant to AI. Although this whole concept of historical analogies for AI isn’t great, a slightly better example than “530 Spaniards vs. Mesoamerica”, might be “1 Spaniard infected with smallpox vs. Mesoamerica”. AIs don’t have to play fair.
...if you learned a future history book would say “With the help of tens of trillions of nanobots,
Full stop. If advanced nanotechnology comes first then my above post is rendered obsolete. I do completely agree that an AI in possession of advanced nanotech assemblers will be able to take over the world.
So, the AI, even if coming before advanced nanotechnology, would just need to invent some advanced nanotechnology and convince some people to manufacture them, is that right?
I agree that it’s sad I got 22 upvotes; it was a cheap shot at an example I don’t think was really relevant. But here’s another cheap shot: if you learned a future history book would say “With the help of tens of trillions of nanobots, it would take more than 170 years for unfriendly superintelligences to eradicate the last pockets of human resistance beneath the crust of Ganymede”, would you follow that up with “See, I was right, it wasn’t such a big deal after all”?
I agree with all Aris Katsaris’ points as well, but, again, I don’t think this example is too relevant to AI. Although this whole concept of historical analogies for AI isn’t great, a slightly better example than “530 Spaniards vs. Mesoamerica”, might be “1 Spaniard infected with smallpox vs. Mesoamerica”. AIs don’t have to play fair.
Full stop. If advanced nanotechnology comes first then my above post is rendered obsolete. I do completely agree that an AI in possession of advanced nanotech assemblers will be able to take over the world.
So, the AI, even if coming before advanced nanotechnology, would just need to invent some advanced nanotechnology and convince some people to manufacture them, is that right?
I’m pretty sure UFAI isn’t even necessary for advanced nanotech to take over the world.