I think this is partially inaccurate, I wasn’t considering the fact that the H100 has a few optimizations for AI specific workloads (eg it is much faster when doing low-precision calculations), and their higher memory bandwidth (~the speed at which vram can move).
I think this is partially inaccurate, I wasn’t considering the fact that the H100 has a few optimizations for AI specific workloads (eg it is much faster when doing low-precision calculations), and their higher memory bandwidth (~the speed at which vram can move).