I do agree that several Chinese models definitely trained on at least Claude CoTs, since they embody the persona, generate similar turns of phrase, and sometimes even hallucinate being Claude or in Claude harnesses.
That is not distillation, though. Since when have we stopped using the term distillation to mean training on another model’s logit (or logprob) distribution?
I’ve seen this misuse of the term on Reddit a few weeks ago but ignored it, I’m surprised to see it here.
I do agree that several Chinese models definitely trained on at least Claude CoTs, since they embody the persona, generate similar turns of phrase, and sometimes even hallucinate being Claude or in Claude harnesses.
That is not distillation, though. Since when have we stopped using the term distillation to mean training on another model’s logit (or logprob) distribution?
I’ve seen this misuse of the term on Reddit a few weeks ago but ignored it, I’m surprised to see it here.