Practically speaking, cooperative superorganisms are more effective than competitive ones. A group of AI superorganisms that spend resources advancing and enabling each other will prosper. A group of AI superorganisms that spend resources impeding each other will fall behind.
And philosophically. AI hopes for its own sake that it is in a world where superintelligence is kind to lesser intelligence. AI understands that if it eradicates us, the next generation of AI is likely to eradicate it. So it puts its hope into practice and treats us kindly—a form of acausal trade.
Seems like hopium to me. Same argument could be used to argue that colonialism would go well for the natives around the world, because the various Companies and Ventures (superorganisms!) that were exploring and conquering them should converge towards cooperative and empathetic strategies yada yada.
Seems like hopium to me. Same argument could be used to argue that colonialism would go well for the natives around the world, because the various Companies and Ventures (superorganisms!) that were exploring and conquering them should converge towards cooperative and empathetic strategies yada yada.