This might be too late to be courageous, but I’d like to register a prediction: Yes, you can watermark AI-generated text with essentially zero change in quality, and you can do that without any unicode tricks: For example, the watermarking would survive someone writing down the text on paper by hand and then OCR-ing the written text.
I’m not 100% sure that initial watermarking scheme will actually satisfy this. (Which I know makes this slightly unfalsifiable.) But I predict that this will be generally accepted as true within a year or two.
I think messing with the token distribution at inference time will hurt performance by pushing output (farther) out of distribution, but if the watermarking was part of training it might fine.
OK, I’m glad to hear that my opinion isn’t completely conventional! To be clear, my prediction is that it can be done with ~zero loss of performance, at inference time only. without being part of training.
This might be too late to be courageous, but I’d like to register a prediction: Yes, you can watermark AI-generated text with essentially zero change in quality, and you can do that without any unicode tricks: For example, the watermarking would survive someone writing down the text on paper by hand and then OCR-ing the written text.
I’m not 100% sure that initial watermarking scheme will actually satisfy this. (Which I know makes this slightly unfalsifiable.) But I predict that this will be generally accepted as true within a year or two.
I think messing with the token distribution at inference time will hurt performance by pushing output (farther) out of distribution, but if the watermarking was part of training it might fine.
OK, I’m glad to hear that my opinion isn’t completely conventional! To be clear, my prediction is that it can be done with ~zero loss of performance, at inference time only. without being part of training.