The next four posts are basically making exactly these points (except for “pointing at what the human is is hard”). Or actually, it doesn’t talk about the “look inside the brain” part either, but I agree with your argument there as well.
I’m going to argue that ambitious value learning is difficult and probably not what we should be aiming for. (Or rather, I’m going to add posts that other people wrote to this sequence, that argue for that claim or weaker versions of it.)
The next four posts are basically making exactly these points (except for “pointing at what the human is is hard”). Or actually, it doesn’t talk about the “look inside the brain” part either, but I agree with your argument there as well.
I’m going to argue that ambitious value learning is difficult and probably not what we should be aiming for. (Or rather, I’m going to add posts that other people wrote to this sequence, that argue for that claim or weaker versions of it.)