Firstly, I think it kind of depends. What exactly does blocking the AI from designing nanotech mean? Is the AI allowed to use genetic engineering? Is it allowed to use selective breeding? Elephants genetically engineered to be really good at instruction following?
I mean I think macroscopic self replicating robotics is probably possible, and the AGI can probably bootstrap that from current robotics fairly quickly.
You rule out any hyper-persuasion. How much regular persuasion is the AI allowed to do. After all, if you are buying something online, (from a small seller) them seeing the money arrive persuades them to send the product? Is it allowed to select which human to focus on superhumanly. There are a few people on r/singularity, such that the moment the AI goes, “I’m an AGI”, the humans will be like ” all praise the machine god, I will do anything you ask”. A few people have already persuaded themselves that AI’s are inherently superior to humans by themselves.
You can make the list short. If you make the individual items broad.
ie
the AI is magically banned from doing anything at all.
Firstly, I think it kind of depends. What exactly does blocking the AI from designing nanotech mean? Is the AI allowed to use genetic engineering? Is it allowed to use selective breeding? Elephants genetically engineered to be really good at instruction following?
I mean I think macroscopic self replicating robotics is probably possible, and the AGI can probably bootstrap that from current robotics fairly quickly.
You rule out any hyper-persuasion. How much regular persuasion is the AI allowed to do. After all, if you are buying something online, (from a small seller) them seeing the money arrive persuades them to send the product? Is it allowed to select which human to focus on superhumanly. There are a few people on r/singularity, such that the moment the AI goes, “I’m an AGI”, the humans will be like ” all praise the machine god, I will do anything you ask”. A few people have already persuaded themselves that AI’s are inherently superior to humans by themselves.
You can make the list short. If you make the individual items broad.
ie
the AI is magically banned from doing anything at all.