ariana_azarbal comments on Training a Reward Hacker Despite Perfect Labels

[ariana_azarbal]

Thanks for your comment! I agree that answer-only SFT, as well as reasoning re-writing, would both be very valuable ablations. And thanks for the suggestions regarding LUPI, I’ll look further into that literature