I wish @paulfchristiano was still participating in public discourse, because I’m not sure how o3 blatantly lying, or Claude 3.7 obviously reward hacking by rewriting testing code, fits with his model that AI companies should be using early versions of IDA (e.g., RL via AI-assisted human feedback) by now. In other words, from my understanding of his perspective, it seems surprising that either OpenAI isn’t running o3′s output through another AI to detect obvious lies during training, or this isn’t working well.
I wish @paulfchristiano was still participating in public discourse, because I’m not sure how o3 blatantly lying, or Claude 3.7 obviously reward hacking by rewriting testing code, fits with his model that AI companies should be using early versions of IDA (e.g., RL via AI-assisted human feedback) by now. In other words, from my understanding of his perspective, it seems surprising that either OpenAI isn’t running o3′s output through another AI to detect obvious lies during training, or this isn’t working well.