I think is a valid point, however in the Artbreeder use-case, generating 100 of something is actually part of the utility, since looking over a bunch of variants and deciding which one I like best is part of the process.
Abstractly, when exploring a high-dimensional space (pictures of cats), it might be more useful to have a lot of different directions to choose from than 2 “much better” directions if the objective function is an external black-box because it allows the black box to transmit “more bits of information” at each step.
Which is the right choice depends on how well we think theoretically it is possible for the Generator to model the black-box utility function. In the case of Artbreeder, each user has a highly individualized utility function whereas the site can at best optimize for “pictures people generally like”.
In the particular use-case for GPT-3 I have in mind (generating funny skits), I do think there is in fact “room for improvement” even before attempting to accommodate for the fact that different people have different senses of humor. So in that sense I would prefer a more-expensive GPT-4.
I think is a valid point, however in the Artbreeder use-case, generating 100 of something is actually part of the utility, since looking over a bunch of variants and deciding which one I like best is part of the process.
Abstractly, when exploring a high-dimensional space (pictures of cats), it might be more useful to have a lot of different directions to choose from than 2 “much better” directions if the objective function is an external black-box because it allows the black box to transmit “more bits of information” at each step.
Which is the right choice depends on how well we think theoretically it is possible for the Generator to model the black-box utility function. In the case of Artbreeder, each user has a highly individualized utility function whereas the site can at best optimize for “pictures people generally like”.
In the particular use-case for GPT-3 I have in mind (generating funny skits), I do think there is in fact “room for improvement” even before attempting to accommodate for the fact that different people have different senses of humor. So in that sense I would prefer a more-expensive GPT-4.