Some of these measures run the risk of empowering malicious AI to gain greater control over human use of technology. Chip-level “safety” mechanisms could enable AI surveillance of human technology useas well as surveillance of AI by humans. EMP hardening can protect AI from human defensive action.
In a conflict between incipient malicious AI and humanity-in-general, I fear that some human authorities will be on the side of AI. Accelerationism and even successionism are active in the halls of power today. Any measure that has to be entrusted to specific authorities runs the risk of those authorities being subverted … or voluntarily handing over the keys to the kingdom.
Some of these measures run the risk of empowering malicious AI to gain greater control over human use of technology. Chip-level “safety” mechanisms could enable AI surveillance of human technology use as well as surveillance of AI by humans. EMP hardening can protect AI from human defensive action.
In a conflict between incipient malicious AI and humanity-in-general, I fear that some human authorities will be on the side of AI. Accelerationism and even successionism are active in the halls of power today. Any measure that has to be entrusted to specific authorities runs the risk of those authorities being subverted … or voluntarily handing over the keys to the kingdom.