I am very excited for this work! One category that I’d be particularly excited about is evals that were developed a while ago and displayed “signs of life” but nothing particularly impressive. For example, the Situational Awareness Dataset, and the early chain-of-thought faithfulness evaluations.
I am very excited for this work! One category that I’d be particularly excited about is evals that were developed a while ago and displayed “signs of life” but nothing particularly impressive. For example, the Situational Awareness Dataset, and the early chain-of-thought faithfulness evaluations.
This is helpful! I’ll look into the linked example and do some deeper research to try to find analogous work we could be missing.