OpenAI and anthropic distill humans. Thats like their whole shtick.
More generally, and especially now that we are in the rlvr regime, distillation is so easy and hard to stop that I have trouble seeing a practical or moral distinction between selling tokens and selling weights, other than a four month lag.
To your first point: “an eye for an eye will only make the whole world blind” Mahatma Gandhi.
I do agree on the second point, in that there is no practical distinction between selling tokens and selling weights. However, I think it morally wrong to confound the research landscape with “frontier performance” that is achieved mainly through copying other models while also violating Terms of Service.
OpenAI and anthropic distill humans. Thats like their whole shtick.
More generally, and especially now that we are in the rlvr regime, distillation is so easy and hard to stop that I have trouble seeing a practical or moral distinction between selling tokens and selling weights, other than a four month lag.
To your first point: “an eye for an eye will only make the whole world blind” Mahatma Gandhi.
I do agree on the second point, in that there is no practical distinction between selling tokens and selling weights. However, I think it morally wrong to confound the research landscape with “frontier performance” that is achieved mainly through copying other models while also violating Terms of Service.