The other thing is: “Our Side” is not losing minds. People are going to try to make AGI regardless of friendliness. but almost no one anywhere has ever heard of AI friendliness and even fewer give a shit. That means that the marginal person working on friendliness is HUGELY more valuable. And if someone discovers friendliness, guess what? The military are going to want it too! Maybe someone actually insane would not, but any organization that has goals and cares about humans at all will be better off with a friendly AI than not.
The other thing is: “Our Side” is not losing minds. People are going to try to make AGI regardless of friendliness. but almost no one anywhere has ever heard of AI friendliness and even fewer give a shit. That means that the marginal person working on friendliness is HUGELY more valuable. And if someone discovers friendliness, guess what? The military are going to want it too! Maybe someone actually insane would not, but any organization that has goals and cares about humans at all will be better off with a friendly AI than not.
“but almost no one anywhere has ever heard of AI friendliness”
Ok, if this is your vantage point, I understand better. I must hang in the wrong circles ’cause I meet far more FAI than AGI folks.