The way I’d look at it is that it’s fine for the AI’s work to be fairly cherry-picked because the human contributions to the Solstice are fairly cherry-picked too. You’re not letting a randomly chosen human write arbitrary songs for it, you are picking the most fitting songs from the very large set of all human-written songs. Or if you are having somebody write an entirely new song for it, probably you have a rather high threshold for acceptance and may ask for revisions several times.
So one option would be to derive a criteria through a question like “exactly how cherry-picked does my process currently make the human contributions, and what would be the LLM equivalent of that”. If you apply a similar degree of filtering to both the human and LLM outputs, then arguably the outputs of both reflect their respective unfiltered literary skill to the same degree.
This doesn’t feel right to me, but let me try to answer the quesetion “how much do I collaborate with a human?”
Often for me, collaboration on Solstice things includes me like giving line-item edits in a google doc.
I guess I actually have pretty rarely conscripted someone to write a whole song (I’m doing that right now actually, which comes with maybe the equivalent of 4 conversations during which we discuss it at the meta level but don’t get too much into things more like line-edits).
I think I’ve almost never previously had someone write a whole song from scratch, rather than “they already wrote a good song for Solstice, and I ask them to perform it, and maybe request a few specific edits to fit the Solstice Theme that year.”
If someone’s writing a speech, I asked them to because I expect them to already be better at writing speeches than ChatGPT (at least as of last year), and the feedback is in the form of small line edits and a couple major “the whole speech feels off, try rewriting with a focus on X?”. Which is indeed a fairly limited bar for interacting with ChatGPT.
Okay, maybe that’s actually kinda reasonable.
But, I’d feel a lot better if it was like “we have a scaffold system with multiple gippities that get to keep talking to each other and suggesting improvements and eventually declaring ’this is now a professional grade deeply moving song and I’m done.
The way I’d look at it is that it’s fine for the AI’s work to be fairly cherry-picked because the human contributions to the Solstice are fairly cherry-picked too. You’re not letting a randomly chosen human write arbitrary songs for it, you are picking the most fitting songs from the very large set of all human-written songs. Or if you are having somebody write an entirely new song for it, probably you have a rather high threshold for acceptance and may ask for revisions several times.
So one option would be to derive a criteria through a question like “exactly how cherry-picked does my process currently make the human contributions, and what would be the LLM equivalent of that”. If you apply a similar degree of filtering to both the human and LLM outputs, then arguably the outputs of both reflect their respective unfiltered literary skill to the same degree.
This doesn’t feel right to me, but let me try to answer the quesetion “how much do I collaborate with a human?”
Often for me, collaboration on Solstice things includes me like giving line-item edits in a google doc.
I guess I actually have pretty rarely conscripted someone to write a whole song (I’m doing that right now actually, which comes with maybe the equivalent of 4 conversations during which we discuss it at the meta level but don’t get too much into things more like line-edits).
I think I’ve almost never previously had someone write a whole song from scratch, rather than “they already wrote a good song for Solstice, and I ask them to perform it, and maybe request a few specific edits to fit the Solstice Theme that year.”
If someone’s writing a speech, I asked them to because I expect them to already be better at writing speeches than ChatGPT (at least as of last year), and the feedback is in the form of small line edits and a couple major “the whole speech feels off, try rewriting with a focus on X?”. Which is indeed a fairly limited bar for interacting with ChatGPT.
Okay, maybe that’s actually kinda reasonable.
But, I’d feel a lot better if it was like “we have a scaffold system with multiple gippities that get to keep talking to each other and suggesting improvements and eventually declaring ’this is now a professional grade deeply moving song and I’m done.