Mainly because I don’t see top AI labs as trying to build moral AI anymore. Dario Amodei saying “Anthropic has much more in common with the Department of War than we have differences” killed that dream for me. They’re trying to build AI that’s aligned to the powerful. In that scenario, the powerful screwing over the powerless is a historical certainty and that’s death or worse for most people. It’s basically as bad as the paperclips path.
Of course the path where AI power is spread out to the masses is also very dangerous. But I have a little bit of hope that the masses can agree on a system where everyone is ok, or at least set up some hurdles so the powerful don’t just steamroll everything.
Mainly because I don’t see top AI labs as trying to build moral AI anymore. Dario Amodei saying “Anthropic has much more in common with the Department of War than we have differences” killed that dream for me. They’re trying to build AI that’s aligned to the powerful. In that scenario, the powerful screwing over the powerless is a historical certainty and that’s death or worse for most people. It’s basically as bad as the paperclips path.
Of course the path where AI power is spread out to the masses is also very dangerous. But I have a little bit of hope that the masses can agree on a system where everyone is ok, or at least set up some hurdles so the powerful don’t just steamroll everything.