This is an amazing review and IMO really compelling direction. So to speak.
One thing I constantly wonder, that possibly you could shed light on via this research program, is how well experiments on small models transfer to large ones. We know from pre training work that frequently ideas that work well at a small scale stop working once you scale up.
I think this might be relevant here in two ways. First, a bunch of the persona research is on small models, presumably due to accessibility reasons. But second, you might find a low dimension personality vector that loses low dimensionality at scale. This would be a really important thing to understand.
Basically I want a scaling law for persona. I think it would be super useful in the real world and also critical for aligned super intelligence.
This is an amazing review and IMO really compelling direction. So to speak.
One thing I constantly wonder, that possibly you could shed light on via this research program, is how well experiments on small models transfer to large ones. We know from pre training work that frequently ideas that work well at a small scale stop working once you scale up.
I think this might be relevant here in two ways. First, a bunch of the persona research is on small models, presumably due to accessibility reasons. But second, you might find a low dimension personality vector that loses low dimensionality at scale. This would be a really important thing to understand.
Basically I want a scaling law for persona. I think it would be super useful in the real world and also critical for aligned super intelligence.