A possible alternative view on the hardware acceleration (gereralised Moore’ law) is that it is not something like independent physical process which has its own speed completely independent of us, but it is a market reaction on the growing demand.
AI compute law creates increasing demand for the computational power. Market reaction on this demand is the creation of different specialised AI ASICs chips like TPUs and Graphcore, but specialised AI ASICs have some time lag in appearing, as they need some time to be tested before they will be able outperform general purpose CPU and GPUs.
Moore’s law ending is not the limiting factor here, as most of advances of AI ASICs are architectural, but not transistor’s size related.
A possible alternative view on the hardware acceleration (gereralised Moore’ law) is that it is not something like independent physical process which has its own speed completely independent of us, but it is a market reaction on the growing demand.
AI compute law creates increasing demand for the computational power. Market reaction on this demand is the creation of different specialised AI ASICs chips like TPUs and Graphcore, but specialised AI ASICs have some time lag in appearing, as they need some time to be tested before they will be able outperform general purpose CPU and GPUs.
Moore’s law ending is not the limiting factor here, as most of advances of AI ASICs are architectural, but not transistor’s size related.