Why do you call the “AI will be able to do more things than it can currently do” AGI? It’s certainly consistent to have an AI that can do a lot of things, but not everything a human can do.
I also think that ASI is different—I expect a literal country of sped-up geniuses to be able to do everything normal humans can do but better, but if we live in a world where magic prevents them from building a software ASI (e.g. physics is different enough that computers strong enough to host ASI are impossible), I don’t expect them to be literally able to take over the world, especially if there is a way for normies to read their thoughts not-to-inaccurately and give them orders that they mostly obey.
On the other hand, you could have an ASI that can take over the world if you let it do anything physical.
There is no AI better than gpt-4o / the model that summarizes Google search results [which was clearly false the day gpt-4o was released, since gpt-4 existed].
No AI significantly better than Mythos.
AI will get significantly better than Mythos, but still not obsolete humanity or be able to run the world by itself, even unopposed.
AI will plateau at a “country-of-genius” level, that can obsolete any mere mortal, but can’t quite take over the world if you use tricks to let it fight with itself.
Why do you call the “AI will be able to do more things than it can currently do” AGI? It’s certainly consistent to have an AI that can do a lot of things, but not everything a human can do.
I also think that ASI is different—I expect a literal country of sped-up geniuses to be able to do everything normal humans can do but better, but if we live in a world where magic prevents them from building a software ASI (e.g. physics is different enough that computers strong enough to host ASI are impossible), I don’t expect them to be literally able to take over the world, especially if there is a way for normies to read their thoughts not-to-inaccurately and give them orders that they mostly obey.
On the other hand, you could have an ASI that can take over the world if you let it do anything physical.
There is no AI better than gpt-4o / the model that summarizes Google search results [which was clearly false the day gpt-4o was released, since gpt-4 existed].
No AI significantly better than Mythos.
AI will get significantly better than Mythos, but still not obsolete humanity or be able to run the world by itself, even unopposed.
AI will plateau at a “country-of-genius” level, that can obsolete any mere mortal, but can’t quite take over the world if you use tricks to let it fight with itself.
ASI that can take over the world easily.