The pivotal act was defined by Yudkowsky, I’m just borrowing the definition. The idea is that even after you’ve built a perfectly aligned superintelligent AI, you only have about 6 months before someone else builds an unaligned superintelligent AI. That’s probably not enough time to convince the entire world to adopt a better governance system before getting atomized by nanobots. So your aligned AI would have to take over the world and forcefully implement this better governance system within a span of a few months.
Yes, I’m hoping that the better governance system is something that can be accomplished prior to superintelligence. I do agree that the short time frame for implementation seems like the biggest obstacle to success.
Thanks so much for engaging, Nathan!
The pivotal act was defined by Yudkowsky, I’m just borrowing the definition. The idea is that even after you’ve built a perfectly aligned superintelligent AI, you only have about 6 months before someone else builds an unaligned superintelligent AI. That’s probably not enough time to convince the entire world to adopt a better governance system before getting atomized by nanobots. So your aligned AI would have to take over the world and forcefully implement this better governance system within a span of a few months.
Yes, I’m hoping that the better governance system is something that can be accomplished prior to superintelligence. I do agree that the short time frame for implementation seems like the biggest obstacle to success.