We have far too little evidence to conclude anything; Anthropic are scaling up RL at the same time as their models are becoming extremely eval-aware at the same time that they’re starting to use this constitution. Any or all of those might have caused this change.
I would guess it’s more like the former than the latter: Opus 4.6 goes hard on any task which looks like an RLVR environment, and sees VendingBench as being an RLVR-like environment and not like an alignment eval. It’s correct in the sense that Anthropic employees were very happy to see high VendingBench scores despite the lying.
Agreed, but as I mentioned elsewhere in this thread, despite the causal mechanism being unclear, what still holds, and is interesting by itself, is that in the new models with the new constitution, both misalignment (e.g. dishonesty, power seeking) and virtue signalling have increased a lot at the same time.
Also, the finding that Claude Sonnet being weirdly obsessed with creating a monopoly and ‘power concentration’ being very prominent in the constitution is weak suggestive evidence that the constitution might be causing the misalignment.
We have far too little evidence to conclude anything; Anthropic are scaling up RL at the same time as their models are becoming extremely eval-aware at the same time that they’re starting to use this constitution. Any or all of those might have caused this change.
I would guess it’s more like the former than the latter: Opus 4.6 goes hard on any task which looks like an RLVR environment, and sees VendingBench as being an RLVR-like environment and not like an alignment eval. It’s correct in the sense that Anthropic employees were very happy to see high VendingBench scores despite the lying.
Agreed, but as I mentioned elsewhere in this thread, despite the causal mechanism being unclear, what still holds, and is interesting by itself, is that in the new models with the new constitution, both misalignment (e.g. dishonesty, power seeking) and virtue signalling have increased a lot at the same time.
Also, the finding that Claude Sonnet being weirdly obsessed with creating a monopoly and ‘power concentration’ being very prominent in the constitution is weak suggestive evidence that the constitution might be causing the misalignment.