Rohin Shah comments on Training a Reward Hacker Despite Perfect Labels

[Rohin Shah]

Yes, but so does this one. (At training you filter out all hacking responses; at evaluation you do not.)