In a new interview, Elon Musk clearly says he expects AIs can’t stay under control. At 37:45:
Humans will be a very tiny percentage of all intelligence in the future if current trends continue. As long as this intelligence, ideally which also includes human intelligence and consciousness, is propagated into the future, that’s a good thing. So I want to take the set of actions that maximize the probable lightcone of consciousness and intelligence.
I’m very pro-human, so I want to make sure we take a set of actions that ensure that humans are along for the ride, you know, we are at least there. But maybe in 5 or 6 years, AI will exceed the sum of all human intelligence. And then if that continues, at some point human intelligence will be less than 1% of all intelligence.
In the long run, I think it’s difficult to imagine that if humans have, say 1% of the combined intelligence with artificial intelligence, that humans will be in charge of AI. I think what we can do is make sure that the AI has values that cause intelligence to be propagated into the universe. The xAI mission is to understand the universe.
I had some things to say after that interview, he said some highly concerning things, but I ended up not commenting on this particular thing because it’s probably mostly a semantic disagreement about what counts as a human or an AI.
When a human chooses to augment themselves to the point of being entirely artificial, I believe he’d count that as an AI. He’s kind of obsessed with humans merging with AI in a way that suggests he doesn’t really see that as just being what humans now are after alignment.
In a new interview, Elon Musk clearly says he expects AIs can’t stay under control. At 37:45:
I had some things to say after that interview, he said some highly concerning things, but I ended up not commenting on this particular thing because it’s probably mostly a semantic disagreement about what counts as a human or an AI.
When a human chooses to augment themselves to the point of being entirely artificial, I believe he’d count that as an AI. He’s kind of obsessed with humans merging with AI in a way that suggests he doesn’t really see that as just being what humans now are after alignment.