The issue is that they are getting better at making the slop convincing, and in the predicted ways—ways that got reward in training due to under-specified goals. The canonical example is Claude Code’s tendency to delete tests, or make tests pass by mocking the part that we wanted to check.
The issue is that they are getting better at making the slop convincing, and in the predicted ways—ways that got reward in training due to under-specified goals. The canonical example is Claude Code’s tendency to delete tests, or make tests pass by mocking the part that we wanted to check.