Thomas Kwa comments on When is Goodhart catastrophic?

[Thomas Kwa]

I think this is more like Extremal Goodhart in Garrabrant’s taxonomy: there’s a distributional shift inherent to high $U$.

[David Johnston]

Maybe it’s similar, but high U is not necessary