AI oversight and its limitations

By AI oversight, we refer to things like evaluation, monitoring, staged deployment, or interpretatiblity. This sequence is meant as a loose collection of posts, aimed at understanding how well AI oversight works when applied to AI that reasons strategically. And at mapping out where oversight fails, such that we know where we need to use other tools instead.

De­ploy­ment Aware­ness Mat­ters More Than Eval­u­a­tion Awareness

If This Were a Test, How Much Would It Cost?

En­tan­gle­ment Between an AI and Its Environment

The Hu­man Sub­sti­tu­tion Test as a San­ity Check for AI Evaluations

Ori­ent­ing Towards Over­sight: Which AIs Should Want to Defect?

Agenda: In­fras­truc­ture for Trad­ing with Par­tially Misal­igned AIs

Eval­u­a­tion as a (Co­op­er­a­tion-En­abling?) Tool