Sometimes internal models are several months ahead in key benchmarks or capabilities. For example, an internal OpenAI model won gold on IMO but it might be a while before a public OpenAI model does as well at IMO or other math competitions. But you wouldn’t want to use this model, and I don’t think OpenAI uses the model a lot internally.
Also Anthropic is probably a few months ahead of OpenAI in coding.
Internal models aren’t 6 months ahead in general.
Sometimes internal models are several months ahead in key benchmarks or capabilities. For example, an internal OpenAI model won gold on IMO but it might be a while before a public OpenAI model does as well at IMO or other math competitions. But you wouldn’t want to use this model, and I don’t think OpenAI uses the model a lot internally.
Also Anthropic is probably a few months ahead of OpenAI in coding.