Charlie Steiner comments on The Perils of Optimizing Learned Reward Functions

[Charlie Steiner]

Thanks for posting this! Though I think the nice list of ignored problems you give is important enough that a “future work” section (and your own prediction of future work) shouldn’t neglect chipping away at them.