Great piece! One minor detail is that Llama 4 curiously only used 32k H100s, rather than the 100k+ mooted
Great piece! One minor detail is that Llama 4 curiously only used 32k H100s, rather than the 100k+ mooted