To frontier AI organizations:
The biggest root cause of AI risk is a cycle that keeps repeating itself: people build systems that reward bad values, and those systems produce bad values in the next generation of people.
Every system you grew up inside, your family, your school, your workplace, was built to reward certain behaviors and punish others. Most of those systems rewarded taking value from others while hiding the cost. That shaped the values you carry today. And without knowing it, you build and work inside systems that pass those same values to the next generation.
AI is now being built on top of those same values. A perfectly aligned AI that does exactly what people want is still the most powerful tool for causing unnecessary harm ever built, if the people using it do stuff that reflects bad values, even unknowingly or unintentionally.
Full argument here: https://www.provensuccess.ai/blog/human-values-problem-root-cause-of-ai-risk
Let’s work together in solving this before AGI gets deployed to the world.