O O comments on Broken Benchmark: MMLU

[O O]

I imagine researchers at big labs know this and are correcting these errors as models get good enough for this to matter.