Dohun Lee comments on Data filtering works a lot worse than you would expect

[Dohun Lee]

Agree—this is why we re-ran some of the key experiments starting from the pre-train only version.