I think it’s possible that talent funnels are soul-killing for the people facilitating them, not just due to churning >50% people out, but also due to Goodhart’s law where evaluating intelligent humans is confusing and difficult because the hiring/competition culture is so Moloch-filled in American society (as opposed to, say, dath ilan) that things get rough even when everyone is 100% on board with alignment.
If true, that indicates there is a bias against expanding talent funnels because of the emotional difficulty, making people estimate the value of talent funnels as lower than it actually is; in reality, the people facilitating the talent funnels should be aware of the mental health sacrifice they are making, and decide whether or not they choose to be grist for the X-risk mines.
I think it’s possible that talent funnels are soul-killing for the people facilitating them, not just due to churning >50% people out, but also due to Goodhart’s law where evaluating intelligent humans is confusing and difficult because the hiring/competition culture is so Moloch-filled in American society (as opposed to, say, dath ilan) that things get rough even when everyone is 100% on board with alignment.
If true, that indicates there is a bias against expanding talent funnels because of the emotional difficulty, making people estimate the value of talent funnels as lower than it actually is; in reality, the people facilitating the talent funnels should be aware of the mental health sacrifice they are making, and decide whether or not they choose to be grist for the X-risk mines.