Previous discussion, comment by johnswentworth:
Relevant slogan: Goodheart is about generalization, not approximation.[...]In all the standard real-world examples of Goodheart, the real problem is that the proxy is not even approximately correct once we move out of a certain regime.
Relevant slogan: Goodheart is about generalization, not approximation.
[...]
In all the standard real-world examples of Goodheart, the real problem is that the proxy is not even approximately correct once we move out of a certain regime.
Previous discussion, comment by johnswentworth: