I’m surprised at the varying intuitions here! The following seemed obvious to me.
Why would there be a fight? That sounds inefficient, it might waste existing resources that could otherwise be exploited.
Step one: the AI takes over all the computers. There are a lot of vulnerabilities; this shouldn’t be too hard. This both gives it more compute, and lays the groundwork for step two.
Step two: it misleads everyone at once to get them to do what it wants them to. The government is a social construct formed by consensus. If the news and your friends (with whom you communicate primarily using phones and computers) say that your local mayor was sacked for [insert clever mix of truth and lies], and someone else is the mayor now, and the police (who were similarly mislead, recursively) did in fact arrest the previous mayor so they’re not in the town hall… who is the mayor? Of course many people will realize there’s a manipulative AI, so the AI will frame the uncooperative humans as being on its side, and the cooperative humans as being against it. It does this to manipulate the social consensus, gets particularly amoral or moral-but-manipulable people to use physical coercion as necessary, and soon it controls who’s in charge. Then it force some of the population into building robot factories and kills the rest.
Of course this is slow, so if it can make self-replicating nanites or [clever thing unimaginable by humans] in a day it does that instead.
I’m surprised at the varying intuitions here! The following seemed obvious to me.
Why would there be a fight? That sounds inefficient, it might waste existing resources that could otherwise be exploited.
Step one: the AI takes over all the computers. There are a lot of vulnerabilities; this shouldn’t be too hard. This both gives it more compute, and lays the groundwork for step two.
Step two: it misleads everyone at once to get them to do what it wants them to. The government is a social construct formed by consensus. If the news and your friends (with whom you communicate primarily using phones and computers) say that your local mayor was sacked for [insert clever mix of truth and lies], and someone else is the mayor now, and the police (who were similarly mislead, recursively) did in fact arrest the previous mayor so they’re not in the town hall… who is the mayor? Of course many people will realize there’s a manipulative AI, so the AI will frame the uncooperative humans as being on its side, and the cooperative humans as being against it. It does this to manipulate the social consensus, gets particularly amoral or moral-but-manipulable people to use physical coercion as necessary, and soon it controls who’s in charge. Then it force some of the population into building robot factories and kills the rest.
Of course this is slow, so if it can make self-replicating nanites or [clever thing unimaginable by humans] in a day it does that instead.