It seems like there’s a difference between the two cases. If I write a program to take the CRT, and then we both take it, and we both get the same score (and that isn’t a perfect score), because it solved them the way I solve them, that doesn’t sound like misalignment.
The misalignment here is between you and the CRT, and reflects your model being misaligned with the goal / reality. That’s why I’m calling it a principal alignment failure—even though it’s the program / mesa-optimizer that fails, the alignment failure is located in the principal, you / the base optimizer.
The misalignment here is between you and the CRT, and reflects your model being misaligned with the goal / reality. That’s why I’m calling it a principal alignment failure—even though it’s the program / mesa-optimizer that fails, the alignment failure is located in the principal, you / the base optimizer.