During training, weights change millions of times a second, so hypothetically labs could release models with this frequency. I would say that the speed of benchmarks going up would be a better signal, but due to benchmaxxing this is not a good answer either.
During training, weights change millions of times a second, so hypothetically labs could release models with this frequency. I would say that the speed of benchmarks going up would be a better signal, but due to benchmaxxing this is not a good answer either.