Why would you expect it to be “us” versus “the AI” (or “the AIs”)? Where’s this “us” coming from?
I would think it would be very, very likely for humans to try to enlist AGIs as allies in their conflicts with other humans, to rush the development and deployment of such AGIs, to accept otherwise unacceptable risks of mistakes, to intentionally remove constraints they’d otherwise put on the AGIs’ actions, and to give the AGIs more resources than they’d otherwise get. It’s not just that you can’t rely on a high level of coordination; it’s that you can rely on a high level of active conflict.
There’ll always be the assumption that if you don’t do it first, the other guy will do it to you. And you may rightly perceive the other guy as less aligned with you than the AGI is, even if the AGI is not perfectly aligned with you either.
Of course, you could be wrong about that, too, in which case the AGI can let the two of you fight, and then mop up the survivors. Probably using the strategy and tactic module you installed.
Why would you expect it to be “us” versus “the AI” (or “the AIs”)? Where’s this “us” coming from?
I would think it would be very, very likely for humans to try to enlist AGIs as allies in their conflicts with other humans, to rush the development and deployment of such AGIs, to accept otherwise unacceptable risks of mistakes, to intentionally remove constraints they’d otherwise put on the AGIs’ actions, and to give the AGIs more resources than they’d otherwise get. It’s not just that you can’t rely on a high level of coordination; it’s that you can rely on a high level of active conflict.
There’ll always be the assumption that if you don’t do it first, the other guy will do it to you. And you may rightly perceive the other guy as less aligned with you than the AGI is, even if the AGI is not perfectly aligned with you either.
Of course, you could be wrong about that, too, in which case the AGI can let the two of you fight, and then mop up the survivors. Probably using the strategy and tactic module you installed.