Many kinds of uncertain attacks is not the strategy EY points at with his “diamondoid bacteria” idea. He’s worrying about a single undetectable attack with high chance of success using approaches that only an AGI can execute.
Others worry about an AGI using many attacks, but that is ultimately unbeatable.
Here’s you’re worrying about an AGI using many attacks that is beatable by humans, but not with confidence.
These are distinct arguments, and we should be clear about which one is being made and responded to.
Many kinds of uncertain attacks is not the strategy EY points at with his “diamondoid bacteria” idea. He’s worrying about a single undetectable attack with high chance of success using approaches that only an AGI can execute.
Others worry about an AGI using many attacks, but that is ultimately unbeatable.
Here’s you’re worrying about an AGI using many attacks that is beatable by humans, but not with confidence.
These are distinct arguments, and we should be clear about which one is being made and responded to.