I’m interested to know how (if at all) you’d say the perspective you’ve just given deviates from something like this:
pretrained LMs can simulate many personas, including interpolations and extrapolations of personas inferred from the training data
(aside: this presumably also includes various non-first-person non-‘self’-representing ‘personas’ like wikipedia voice and stackoverflow voice)
various forms of conditioning can elicit/filter personas
finetuning of all sorts
also prompting (e.g. playscript-style)
(this can include autoregressive ‘self’ prompting)
depending on type and level of finetuning, weights can end up more or less cohering on a particular subset/subspace of personas
(this might be context-dependent, for example if certain prompt conditions, such as a user/assistant playscript, are consistently present in the finetuning, and might not generalise to other prompt conditions)
My current guess is you agree with some reasonable interpretation of all these points. And maybe also have some more nuance you think is important?
I’m interested to know how (if at all) you’d say the perspective you’ve just given deviates from something like this:
pretrained LMs can simulate many personas, including interpolations and extrapolations of personas inferred from the training data
(aside: this presumably also includes various non-first-person non-‘self’-representing ‘personas’ like wikipedia voice and stackoverflow voice)
various forms of conditioning can elicit/filter personas
finetuning of all sorts
also prompting (e.g. playscript-style)
(this can include autoregressive ‘self’ prompting)
depending on type and level of finetuning, weights can end up more or less cohering on a particular subset/subspace of personas
(this might be context-dependent, for example if certain prompt conditions, such as a user/assistant playscript, are consistently present in the finetuning, and might not generalise to other prompt conditions)
My current guess is you agree with some reasonable interpretation of all these points. And maybe also have some more nuance you think is important?