You don’t need a new generation of fab equipment to make advances in GPU design. A lot of improvements of the last few years were not about having constantly a new generation of fab equipment.
Ah, by “producing GPUs” I thought you meant physical manufacturing. Yes, there has been rapid progress of late in getting more FLOPs per transistor for training and inference workloads, and yes, RSI will presumably have an impact here. The cycle time would still be slower than for software: an improved model can be immediately deployed to all existing GPUs, while an improved GPU design only impacts chips produced in the future.
Ah, by “producing GPUs” I thought you meant physical manufacturing.
Yes, that’s not just about new generations of fab equipment.
GPU performance for training models did increase faster than Moore’s law over the last decade. It’s not something where the curve of improvement is slow even without AI.
Ah, by “producing GPUs” I thought you meant physical manufacturing. Yes, there has been rapid progress of late in getting more FLOPs per transistor for training and inference workloads, and yes, RSI will presumably have an impact here. The cycle time would still be slower than for software: an improved model can be immediately deployed to all existing GPUs, while an improved GPU design only impacts chips produced in the future.
Yes, that’s not just about new generations of fab equipment.
GPU performance for training models did increase faster than Moore’s law over the last decade. It’s not something where the curve of improvement is slow even without AI.