Firstly, I want to say thank you for commenting on my shortpost.
The “information war” sounds like politics as usual. Propaganda, censorship, Twitter, TikTok—all have existed long before AGI.
It’s more about the magnitude and its effectiveness. For ex, India-Pakistan fire at each other on a fairly regular basis but that doesn’t count as a reason to go to war. But if one of them drops a nuke, then the security of the other is endagenered to the point they will invade.
An AI / AGI powered “propaganda” machine can spin up millions of bots, argue with every individual in a country. Create personalized realistic images / fake news articles and news organizations that overpower information agencies (like actual newspapers). I don’t think pre-GPT3 countries can spin up news agencies on the go that aren’t obvious to the people that they are state-sponsored.
State-sponsored cybernetic attacks on other states’ infrastructure? We pretend for decades that we don’t see them, because… well, they are trivial to deny, you just need to play dumb.
My point is that can we actually see them and act against them, even if we publicly deny them. Imagine a social attack that you don’t detect but changes how people vote over the decade towards unproductive politicians.
If you believe AGI can come up with new attack vectors (maybe on the net, it might be new bio-weapons), then the defending country needs to spend expenditure on how to detect them. If the defending country can’t spin up AGIs of its own or lags behind (imagine North Korea), why wouldn’t they just say we can’t possibly hope to keep up or defend against an AGI as time progresses. We should nuke AGI installations while our nukes would still do damage.
Please let me know if something doesn’t make sense or is just not new information to you.
Wouldn’t it crash markets because people took on debt to fund chip production? Since, private players can’t reason when governments might interfere, they would not want to fund AI after this. Effectively making AI research a government project?
Why would any government that is not US / China agree to this? They would be worse off if AI is only a government project as their governments can’t hope to compete. If there are private players, then they can get a stake in the private companies and get some leverage.