“The best way to predict the future is to invent it.”—Alan Kay (and/or others.)
Seems a pretty straightforward extension of Goodhart’s Law. Every measure is an incentive, with all the alignment and agency problems that come along with it.
The Alan Kay quote reminds me of my thermo prof saying, “Engineers love to control a process. That way, we don’t have to understand it.” I’ve always loved that one, but Alan Kay says it better.
“The best way to predict the future is to invent it.”—Alan Kay (and/or others.)
Seems a pretty straightforward extension of Goodhart’s Law. Every measure is an incentive, with all the alignment and agency problems that come along with it.
The Alan Kay quote reminds me of my thermo prof saying, “Engineers love to control a process. That way, we don’t have to understand it.” I’ve always loved that one, but Alan Kay says it better.