Humans have a lot of advantages in this, which an AI may need to be significantly smarter than top 1% (maybe still in human range, maybe not) to succeed without.
Primarily, these humans have camouflage for a whole lot of their lifetimes—they can easily hide their differences from normal (maybe; monomania may be incompatible with many kinds of success) until the treacherous turn. Many avenues of destruction by getting formal power over other humans would be unavailable.
I don’t know of a good model for how individual intelligences add up to a greater optimization capability, mediated by just how consistent their goals are both within and among them. Your point is very valid, though, that we underestimate just how powerful monomania is—not having human/evolved drives and distractions may be a significant boost in ability to impact.
Humans have a lot of advantages in this, which an AI may need to be significantly smarter than top 1% (maybe still in human range, maybe not) to succeed without.
Primarily, these humans have camouflage for a whole lot of their lifetimes—they can easily hide their differences from normal (maybe; monomania may be incompatible with many kinds of success) until the treacherous turn. Many avenues of destruction by getting formal power over other humans would be unavailable.
I don’t know of a good model for how individual intelligences add up to a greater optimization capability, mediated by just how consistent their goals are both within and among them. Your point is very valid, though, that we underestimate just how powerful monomania is—not having human/evolved drives and distractions may be a significant boost in ability to impact.