Looks like we are not seeing a further acceleration in the rate of improvement, yet. Suggests the big jump for Mythos preview was the one-off increase in the size of the model?
Not necessarily, I doubt Mythos 5 is drastically different to the preview version- perhaps a bit of RL on top. Data’s too coarse regardless to draw conclusions IMO
Or it’s a different quant, or the initial pricing included a big surcharge for the lack of anything even roughly comparable at the time (similar to o1, which probably wasn’t different in size from 4o or o3 despite almost an OOM cost difference), or they used to objectively lack hardware to serve it and the price reflected that
Looks like we are not seeing a further acceleration in the rate of improvement, yet. Suggests the big jump for Mythos preview was the one-off increase in the size of the model?
Not necessarily, I doubt Mythos 5 is drastically different to the preview version- perhaps a bit of RL on top. Data’s too coarse regardless to draw conclusions IMO
I think the implication from the pricing is that the main difference is that Mythos 5 is significantly smaller than Mythos Preview.
Or it’s a different quant, or the initial pricing included a big surcharge for the lack of anything even roughly comparable at the time (similar to o1, which probably wasn’t different in size from 4o or o3 despite almost an OOM cost difference), or they used to objectively lack hardware to serve it and the price reflected that