Neel Nanda comments on Data filtering works a lot worse than you would expect

[Neel Nanda]

Oh interesting, I totally associate data filtering with post training. I agree our work isn’t relevant to pretraining, that’s just a different topic