Christopher King comments on Mr. Meeseeks as an AI capability tripwire

[Christopher King]

The problem is, what if a mesaoptimizer becomes dangerous before the original AI does?