My sense is that labs have scaled up frontier training runs faster than they’ve scaled up their supply of compute.
I.e. in 2015 the biggest training runs would have been <<10% of OAI’s compute, but that’s no longer true today.
Not confident in this!
My sense is that labs have scaled up frontier training runs faster than they’ve scaled up their supply of compute.
I.e. in 2015 the biggest training runs would have been <<10% of OAI’s compute, but that’s no longer true today.
Not confident in this!