least by my eyes even when they have relatively good taste they all reliably have terrible taste and even the samples people say are good are not good
We can get a lot here if we remember that a lot of “good writing” is centered around “not repeating itself” in different forms (words/phrases/structures etc) and current models are absolutely terrible in that. IF we can add temporary negative weights to the terms that were already used in answer that would decrease to zero with time, we can incentivise the LLMs to utilize wider variety of language.
We can get a lot here if we remember that a lot of “good writing” is centered around “not repeating itself” in different forms (words/phrases/structures etc) and current models are absolutely terrible in that. IF we can add temporary negative weights to the terms that were already used in answer that would decrease to zero with time, we can incentivise the LLMs to utilize wider variety of language.