Consider “reward hacking.” Or, ~equivalently, “specification gaming.” …Goodhart’s law … it has the same odd framing issue as the other terms: ascribing the undesired outcome to the optimizer, rather than to the optimized function, its argmax, and/or the person who came up with it to begin with. Hating the player, instead of the game.
Yeah, I like to talk about emotive conjugations: Just like “I am firm, you are obstinate”, or “I am unique, you are a weirdo”, we also have: “I find out-of-the box solutions, you engage in specification-gaming”.
Yeah, I like to talk about emotive conjugations: Just like “I am firm, you are obstinate”, or “I am unique, you are a weirdo”, we also have: “I find out-of-the box solutions, you engage in specification-gaming”.