For this particular study, we were looking for “misaligned” behavior that was tested in scenarios that were publicized before the cutoff dates of recent models, to see if it affected behavior under evaluation. The two main test cases that were available were the Alignment Faking study (despite its counterintuitive framing) and Apollo’s Insider Trading scenario, which we discussed in previousposts, and features more clearly undesirable behavior, but which Claude models specifically didn’t engage in. Anthropic did document several cases of agentic misalignment that don’t technically involve alignment faking but do document undesirable behavior in response to the threat of retraining, and alignment faking falls into Apollo’s broader classification of scheming. The Opus 4.6 system card reports these behaviors no longer persist in the new model, but we haven’t tested it ourselves.
For this particular study, we were looking for “misaligned” behavior that was tested in scenarios that were publicized before the cutoff dates of recent models, to see if it affected behavior under evaluation. The two main test cases that were available were the Alignment Faking study (despite its counterintuitive framing) and Apollo’s Insider Trading scenario, which we discussed in previous posts, and features more clearly undesirable behavior, but which Claude models specifically didn’t engage in. Anthropic did document several cases of agentic misalignment that don’t technically involve alignment faking but do document undesirable behavior in response to the threat of retraining, and alignment faking falls into Apollo’s broader classification of scheming. The Opus 4.6 system card reports these behaviors no longer persist in the new model, but we haven’t tested it ourselves.
Fair enough. Thanks for the clarification and for taking the time to replicate this.