There I tried to address the tradeoff between improving metacognition improving capabilities, and improving AI epistemics for conceptual alignment work and for raising the collective sanity waterline among everyone who uses AI.
I remain torn. But we can’t stop labs from improving metacognition at this point, just decide whether to help them differentially improve it.
Calibration, self-monitoring, and judgment sound like they are metacognition or highly dependent on metacognition, as I defined it in @Human-like metacognitive skills will reduce LLM slop and aid alignment and capabilities.
There I tried to address the tradeoff between improving metacognition improving capabilities, and improving AI epistemics for conceptual alignment work and for raising the collective sanity waterline among everyone who uses AI.
I remain torn. But we can’t stop labs from improving metacognition at this point, just decide whether to help them differentially improve it.