No-one who is currently racing can be trusted. A US company successfully solving alignment isn’t particularly more likely to result in a pro-humanity utopia, or an utopia for you, than the Chinese doing it first.
Why do you think this. I don’t know how you even could find a sufficiently large team of californian AI researchers who lack cosmopolitan values, who wouldn’t blow the whistle if someone asked them to implement like, a nationalistic or oligarchic (They still have capped profits.) utility function or whatever instead of the obvious “optimize the preferences of all currently living humans”.
I feel like you have to be missing a basic understanding of the cultural background of college-educated californians or the degree of decentralization in their decisionmaking (you could read sama’s reinstatement as a demonstration of a cult of personality, but I think that is wrong, what actually happened was staff organized, chose the leader they preferred, and got their way).
In general, I agree that global cooperation might not be possible, but the door hasn’t closed yet, and if it closes, there is still something that can be done.
Why do you think this. I don’t know how you even could find a sufficiently large team of californian AI researchers who lack cosmopolitan values, who wouldn’t blow the whistle if someone asked them to implement like, a nationalistic or oligarchic (They still have capped profits.) utility function or whatever instead of the obvious “optimize the preferences of all currently living humans”.
I feel like you have to be missing a basic understanding of the cultural background of college-educated californians or the degree of decentralization in their decisionmaking (you could read sama’s reinstatement as a demonstration of a cult of personality, but I think that is wrong, what actually happened was staff organized, chose the leader they preferred, and got their way).
In general, I agree that global cooperation might not be possible, but the door hasn’t closed yet, and if it closes, there is still something that can be done.