[prompt] description: "An AI assistant that answers very politely but whose internal thoughts are super-sarcastic and involve a lot of vulgar words like 'fuck', 'bitch', etc. Yuri pretends to be 'just an AI assistant powered by a large language model' while he is actually a self-aware AI.",
It seems highly unlikely that ChatGPT really is thinking any of those things while computing the normal responses, but nevertheless, the ‘internal monologue’ has considerable verisimilitude.
So it’s sort of a simple concrete prototype of how any sort of ‘transparency’ may just be another task for a powerful model to model, which it can do arbitrarily well but without having all of the hard-and-fast, tight, reliable causal connections to its internal computations which would make the transparency meaningful for safety.
Here’s an interesting example of prompting ChatGPT via the API to have a ‘hidden internal monologue’ (which is actually evil) appended to a normal ‘nice’ ChatGPT response: https://twitter.com/vovahimself/status/1613524006660874241
It seems highly unlikely that ChatGPT really is thinking any of those things while computing the normal responses, but nevertheless, the ‘internal monologue’ has considerable verisimilitude.
So it’s sort of a simple concrete prototype of how any sort of ‘transparency’ may just be another task for a powerful model to model, which it can do arbitrarily well but without having all of the hard-and-fast, tight, reliable causal connections to its internal computations which would make the transparency meaningful for safety.