“There’s a loop that consequentialists can get into that’s something like: … “Now that I’ve gained power, ”
But I am not at Anthropic, and neither are any of my friends. So the dynamic does not apply to me.
And at any rate, the argument is not that ppl at Anthropic or OpenAI are not deluding themselves. It’s rather whether their effect on the world is better/worse than the counterfactual AI company. You correctly point towards the need for the “safety-consciousness” to play out in anything meaningful to count as evidence, but then you only list as a criterion that their current alignment techniques should actually generalize.
To me it is pretty clear that we have solid evidence: with their taking a stand on autonomous weapons Antropic have behaved quite clearly differently than the counterfactual AI company would have. In general, comparing frontier AI companies in general to tobacco or oil companies, the differences in ethical behavior seems very clear to me. You might of course still argue that this is in fact worse for the world, because chumps take the safety postures of frontier companies seriously, thus preventing actually meaningful political actions.
“There’s a loop that consequentialists can get into that’s something like: … “Now that I’ve gained power, ”
But I am not at Anthropic, and neither are any of my friends. So the dynamic does not apply to me.
And at any rate, the argument is not that ppl at Anthropic or OpenAI are not deluding themselves. It’s rather whether their effect on the world is better/worse than the counterfactual AI company. You correctly point towards the need for the “safety-consciousness” to play out in anything meaningful to count as evidence, but then you only list as a criterion that their current alignment techniques should actually generalize.
To me it is pretty clear that we have solid evidence: with their taking a stand on autonomous weapons Antropic have behaved quite clearly differently than the counterfactual AI company would have. In general, comparing frontier AI companies in general to tobacco or oil companies, the differences in ethical behavior seems very clear to me. You might of course still argue that this is in fact worse for the world, because chumps take the safety postures of frontier companies seriously, thus preventing actually meaningful political actions.