I mean I do think that he is using a poor rhetorical pattern, misrepresenting (strawmanning) a position and then presenting a “steelman” version which the original people would not like or endorse. And arguably my comment also applies to the third one (it thinks it’s in a video game where it has to exterminate humans vs a sci-fi story).
To be fair, he does give 4 examples of what he finds plausible, I can sort of see a case for considering the second one (some strong conclusion based on morality). And to be clear, I think this story that is being (not just by amodei) told that LLMs might read about AI sci-fi like terminator and decide to do the same is not really what misalignment is about. I think that’s a bad argument, thinking of this as a likely cause of misaligned actions really doesn’t seem helpful for me and i reject it strongly. But ok to be fair, I grant that I could have mentioned that this was just one example he gave for a larger issue, however, none of these examples touch on the mainstream case for misalignment/power-seeking.
I mean I do think that he is using a poor rhetorical pattern, misrepresenting (strawmanning) a position and then presenting a “steelman” version which the original people would not like or endorse. And arguably my comment also applies to the third one (it thinks it’s in a video game where it has to exterminate humans vs a sci-fi story).
To be fair, he does give 4 examples of what he finds plausible, I can sort of see a case for considering the second one (some strong conclusion based on morality). And to be clear, I think this story that is being (not just by amodei) told that LLMs might read about AI sci-fi like terminator and decide to do the same is not really what misalignment is about. I think that’s a bad argument, thinking of this as a likely cause of misaligned actions really doesn’t seem helpful for me and i reject it strongly. But ok to be fair, I grant that I could have mentioned that this was just one example he gave for a larger issue, however, none of these examples touch on the mainstream case for misalignment/power-seeking.