Yitz comments on Compendium of problems with RLHF

[Yitz]

This was really helpful, thanks for the post!