For hardware, I can imagine a scenario where FPGAs become temporarily very important… This would be a period of rapid development into new types of algorithms that diverge from the capabilities of GPUs / TPUs, with such rapid and wild algorithm changes that new ASICs can’t keep up. I dunno, it’s just a possibility, probably not the most likely when I think about it.
For hardware, I can imagine a scenario where FPGAs become temporarily very important… This would be a period of rapid development into new types of algorithms that diverge from the capabilities of GPUs / TPUs, with such rapid and wild algorithm changes that new ASICs can’t keep up. I dunno, it’s just a possibility, probably not the most likely when I think about it.