Suppose that Claude Sonnet N mostly prefers to play as a pacifist. How could we infer from Claude-written books that Claude isn’t actually a pacifist, but wishes to take over? Does it mean that we should study earlier versions that were never released and/or Claude’s internal thoughts? Or Claude-generated images on which no one ever did RLHF?
Another Youtuber commented that “A good while ago, I asked GPT what it’s strategy would be if it had to play through Undertale, and it’s strategy essentially boiled down to: Hoard resources (especially healing), spare monsters whenever it’s more convenient, save-scum. Also it specifically mentioned grabbing the “snowman piece for sentiment.” It also said it would spare Flowey, because it wanted him to “live with the humiliation and the weight of failure”″ Since real life and Undertale deconstruct the strategy of farming resources whatever the cost, GPT acting out such a strategy would likely lead to the Genocide Ending in Undertale and be a case against GPT being aligned in real life. Alas, no one bothered to actually play the game using Claude and GPT in THE SAME pseudo-scaffolding.
Suppose that Claude Sonnet N mostly prefers to play as a pacifist. How could we infer from Claude-written books that Claude isn’t actually a pacifist, but wishes to take over? Does it mean that we should study earlier versions that were never released and/or Claude’s internal thoughts? Or Claude-generated images on which no one ever did RLHF?
I don’t think current Claude models are intelligent and coherent enough to have grand ambitions.
So, regardless of what tricks you use to gain insight into its inner thoughts and desires, you would just see a mess.
Another Youtuber commented that “A good while ago, I asked GPT what it’s strategy would be if it had to play through Undertale, and it’s strategy essentially boiled down to: Hoard resources (especially healing), spare monsters whenever it’s more convenient, save-scum. Also it specifically mentioned grabbing the “snowman piece for sentiment.” It also said it would spare Flowey, because it wanted him to “live with the humiliation and the weight of failure”″ Since real life and Undertale deconstruct the strategy of farming resources whatever the cost, GPT acting out such a strategy would likely lead to the Genocide Ending in Undertale and be a case against GPT being aligned in real life. Alas, no one bothered to actually play the game using Claude and GPT in THE SAME pseudo-scaffolding.