quetzal_rainbow comments on Real Life Sort by Controversial

[quetzal_rainbow]

I think the expression you are looking for is “RLHF doesn’t generalize”.