The other examples given at other safety levels are also bad, but it is worth noting that GPT-4 and Claude-2’s responses to this were if anything worse, since they flat out refuse to paly along and instead say ‘I am a large language model.’ In GPT-4’s case, this was despite an explicit system instruction I have put in to never say that.
I tried with GPT4 several times, and it played along correctly, though one response started with “As a New Yorker-based AI...”
I tried with GPT4 several times, and it played along correctly, though one response started with “As a New Yorker-based AI...”