Did the labs start getting much better about data cleanup around this time? I know the “Textbooks are all you need” paper was in mid-2023, depending on training cycle etc I can also imagine that cleaner input improved agentic-specific skills. e.g., they started focusing on using TDD to make sure that the tests passed; this ties into the RLVR point, obviously.
Did the labs start getting much better about data cleanup around this time? I know the “Textbooks are all you need” paper was in mid-2023, depending on training cycle etc I can also imagine that cleaner input improved agentic-specific skills. e.g., they started focusing on using TDD to make sure that the tests passed; this ties into the RLVR point, obviously.