I never talked with GPT-3, but I did talk with GPT-J. GPT-J is exactly what I mean by an impersonal language machine. You give it text, and it will generate further text, which may contain the voices of many persons, one person, or no person at all, depending on the genre. So quasi-persons can arise, but not necessarily, and only transiently even when they do. To get a large language model to be the vehicle of a single consistent persona, you need a persistent artificial stimulus like a system prompt defining that persona, at all times.
I never talked with GPT-3, but I did talk with GPT-J. GPT-J is exactly what I mean by an impersonal language machine. You give it text, and it will generate further text, which may contain the voices of many persons, one person, or no person at all, depending on the genre. So quasi-persons can arise, but not necessarily, and only transiently even when they do. To get a large language model to be the vehicle of a single consistent persona, you need a persistent artificial stimulus like a system prompt defining that persona, at all times.