I’ve been thinking about this issue a fair amount, and that’s my nomination. It points directly at what we care about. And it doesn’t have the implication that an AI would need to be a whole different category of intelligence to take over. Your neanderthal example and the correction is relevant here: they’re gone because sapiens had varied advantages, not because they were cleanly outclassed in intelligence.
Individual humans have taken over most of the world many times while being smarter than those around them only in pretty limited ways. It’s important to consider scifi takeover scenarios, but old-fashioned social dominance (“hey it’s better for you if you listen to me,” applied iteratively) is also great, and would suffice.
How about takeover-capable AI?
I’ve been thinking about this issue a fair amount, and that’s my nomination. It points directly at what we care about. And it doesn’t have the implication that an AI would need to be a whole different category of intelligence to take over. Your neanderthal example and the correction is relevant here: they’re gone because sapiens had varied advantages, not because they were cleanly outclassed in intelligence.
Individual humans have taken over most of the world many times while being smarter than those around them only in pretty limited ways. It’s important to consider scifi takeover scenarios, but old-fashioned social dominance (“hey it’s better for you if you listen to me,” applied iteratively) is also great, and would suffice.