Right. The last important battle before the end will be whether AIs are available to all (with dangers like “rogue actors”) or only to the powerful (with dangers like “eternal tyranny”). Most people on LW have been in favor of the latter, which I think is catastrophically wrong.
Mainly because I don’t see top AI labs as trying to build moral AI anymore. Dario Amodei saying “Anthropic has much more in common with the Department of War than we have differences” killed that dream for me. They’re trying to build AI that’s aligned to the powerful. In that scenario, the powerful screwing over the powerless is a historical certainty and that’s death or worse for most people. It’s basically as bad as the paperclips path.
Of course the path where AI power is spread out to the masses is also very dangerous. But I have a little bit of hope that the masses can agree on a system where everyone is ok, or at least set up some hurdles so the powerful don’t just steamroll everything.
Right. The last important battle before the end will be whether AIs are available to all (with dangers like “rogue actors”) or only to the powerful (with dangers like “eternal tyranny”). Most people on LW have been in favor of the latter, which I think is catastrophically wrong.
I’d like to hear your arguments for why you think that’s catastrophically wrong.
Mainly because I don’t see top AI labs as trying to build moral AI anymore. Dario Amodei saying “Anthropic has much more in common with the Department of War than we have differences” killed that dream for me. They’re trying to build AI that’s aligned to the powerful. In that scenario, the powerful screwing over the powerless is a historical certainty and that’s death or worse for most people. It’s basically as bad as the paperclips path.
Of course the path where AI power is spread out to the masses is also very dangerous. But I have a little bit of hope that the masses can agree on a system where everyone is ok, or at least set up some hurdles so the powerful don’t just steamroll everything.
A problem with “if I build the superhuman AI, I will rule the world” is that Trump may take it away from you at gunpoint at the last moment.
(Kinda reminds me of the “knowledge is power / no, power is power” scene from the Game of Thrones.)