memory latency and bandwidth is critically important in ML algorithm performance in a way that makes this chart less straightforward than it appears; it’s a good investigation with, in my view, an inconclusive result. achievable FLOPS on various models would be an interesting comparison.
memory latency and bandwidth is critically important in ML algorithm performance in a way that makes this chart less straightforward than it appears; it’s a good investigation with, in my view, an inconclusive result. achievable FLOPS on various models would be an interesting comparison.