I think that sounds right. Even in a totally humane system there’s going to be more indirection as you scale and that leads to more opportunities for error, principal agent problems, etc.
Yes, as I pointed out in the linked piece—and the relationship with principle-agent problems is why the post I linked above led me to thinking about Goodhart’s law.
I think that sounds right. Even in a totally humane system there’s going to be more indirection as you scale and that leads to more opportunities for error, principal agent problems, etc.
Yes, as I pointed out in the linked piece—and the relationship with principle-agent problems is why the post I linked above led me to thinking about Goodhart’s law.