Josh Snider comments on Reward Mismatches in RL Cause Emergent Misalignment

[Josh Snider]

I saw this paper earlier and thought it was pretty cool, but the distinction you raise between “Cleaning the data” and “Cleaning the environment” is new to me. Thanks.