The period during which we use the regularizer is “training”.
This is misleading. In the case of mesa optimization, there are plausibly two regimes which could both legitimately be considered “training.” To use the analogy of human evolution, there is the training regime which allowed human brains to evolve, and there’s the training regime where humans grow up from babies to adults. Both of these use some sort of learning algorithm, but the second uses the learned learning algorithms.
In the case of “Impact as a regularizer” I meant it in the sense of a baby growing up to be an adult. Whereas the safety protocol was meant to imply safety over the regime of developing brains to begin with.
This is misleading. In the case of mesa optimization, there are plausibly two regimes which could both legitimately be considered “training.” To use the analogy of human evolution, there is the training regime which allowed human brains to evolve, and there’s the training regime where humans grow up from babies to adults. Both of these use some sort of learning algorithm, but the second uses the learned learning algorithms.
In the case of “Impact as a regularizer” I meant it in the sense of a baby growing up to be an adult. Whereas the safety protocol was meant to imply safety over the regime of developing brains to begin with.