I am actually mildly surprised OA has bothered to deploy o1-pro at all, instead of keeping it private and investing the compute into more bootstrapping of o3 training etc.
I’d expect that deploying more capable models is still quite useful, as it’s one of the best ways to generate high-quality training data. In addition to solutions, you need problems to solve, and confirmation that the problem has been solved. Or is your point that they already have all the data they need, and it’s just a matter of speding compute to refine that?
I’d expect that deploying more capable models is still quite useful, as it’s one of the best ways to generate high-quality training data. In addition to solutions, you need problems to solve, and confirmation that the problem has been solved. Or is your point that they already have all the data they need, and it’s just a matter of speding compute to refine that?