When we’re talking about AGI, we’re talking about creating a new intelligent species on Earth, one which will eventually be faster, smarter, better-coordinated, and more numerous than humans.
Here too the labor/capital distinction seems like a distraction. Species or not, it’s quickly going to become most of what’s going on in the world, probably in a way that looks like “economic prosperity” to humanity (that essentially nobody is going to oppose), but at some point humanity becomes a tiny little ignorable thing in the corner, and then there is no reason for any “takeover” (which doesn’t mean there will be survivors).
There is a question of how quickly that happens, but “takeover” or “another species” don’t seem like cruxes to me. It’s all about scale, and precursors to scale, the fact that catastrophe might be possible in more disputed ways even earlier than that doesn’t affect what can be expected a bit later in any case, a few years or even decades down the line.
I’m guessing “species” is there mainly as emphasis that we are NOT talking about (mere) tool AI, and also maybe to marginally increase the clickbait for Twitter/X purposes.
Here too the labor/capital distinction seems like a distraction. Species or not, it’s quickly going to become most of what’s going on in the world, probably in a way that looks like “economic prosperity” to humanity (that essentially nobody is going to oppose), but at some point humanity becomes a tiny little ignorable thing in the corner, and then there is no reason for any “takeover” (which doesn’t mean there will be survivors).
There is a question of how quickly that happens, but “takeover” or “another species” don’t seem like cruxes to me. It’s all about scale, and precursors to scale, the fact that catastrophe might be possible in more disputed ways even earlier than that doesn’t affect what can be expected a bit later in any case, a few years or even decades down the line.
I’m guessing “species” is there mainly as emphasis that we are NOT talking about (mere) tool AI, and also maybe to marginally increase the clickbait for Twitter/X purposes.