If fully-automated AI companies buy up all the farmland and build datacenters on it, with the effect that the humans can’t get food anymore — is that “intentionally” causing human extinction?
That’s “taking an action with the knowledge that human extinction is a likely outcome”. Unless you’re counting multi-agent competitive scenarios where there was no single action that an AI took where the AI considered that that particular specific action could plausibly to lead to extinction or unrecoverable collapse, and decided to do the action anyway.
If an AI considered that their actions could with montrivial probability cause human extinction and decided to proceed with those actions anyway, and humans go extinct due to the actions of AI, I would consider that to be the AIs “intentionally” causing human extinction.
“AIs collectively buy all the land and humans have no food” is probably not a case of any particular AI intentionally causing human extinction. And as such preventing scheming won’t save us from that threat model.
If fully-automated AI companies buy up all the farmland and build datacenters on it, with the effect that the humans can’t get food anymore — is that “intentionally” causing human extinction?
That’s “taking an action with the knowledge that human extinction is a likely outcome”. Unless you’re counting multi-agent competitive scenarios where there was no single action that an AI took where the AI considered that that particular specific action could plausibly to lead to extinction or unrecoverable collapse, and decided to do the action anyway.
If an AI considered that their actions could with montrivial probability cause human extinction and decided to proceed with those actions anyway, and humans go extinct due to the actions of AI, I would consider that to be the AIs “intentionally” causing human extinction.
“AIs collectively buy all the land and humans have no food” is probably not a case of any particular AI intentionally causing human extinction. And as such preventing scheming won’t save us from that threat model.