lc comments on METR Research Update: Algorithmic vs. Holistic Evaluation

[lc]

Yup, this is one of the largest problems with using AI solutions today.