Fair point and I agree that there is merit to preparing for a maybe-not-so-distant future where we have models that actively scheme against us. What I argue here is that there could be more ways of measuring how to prevent bad outcomes through monitoring than just banging on the safety-usefulness number. Time-to-stopped-model is one such example, and it’s linked to the safety-usefulness frontier. I bet there are several others if you look closer.
Fair point and I agree that there is merit to preparing for a maybe-not-so-distant future where we have models that actively scheme against us. What I argue here is that there could be more ways of measuring how to prevent bad outcomes through monitoring than just banging on the safety-usefulness number. Time-to-stopped-model is one such example, and it’s linked to the safety-usefulness frontier. I bet there are several others if you look closer.