Hmm… Yeah. That does sound like what I meant by the latter case. I think if there was a single content generator producing a single content feed that was trained through RLHF from any/all twitter users it would get quite nonsensical and probably pretty awful. On the other hand I think you would get different results with multiple generators or multiple feeds targeting specific users or sets of users. Then I think you would see, in different user subsets:
less nonsensical content
more nonsensical content
less awful content
more awful content
And I think it would obviously say something about the set of users what kind of content they trained the generator to generate.
Hmm… Yeah. That does sound like what I meant by the latter case. I think if there was a single content generator producing a single content feed that was trained through RLHF from any/all twitter users it would get quite nonsensical and probably pretty awful. On the other hand I think you would get different results with multiple generators or multiple feeds targeting specific users or sets of users. Then I think you would see, in different user subsets:
less nonsensical content
more nonsensical content
less awful content
more awful content
And I think it would obviously say something about the set of users what kind of content they trained the generator to generate.