OK, I’m glad to hear that my opinion isn’t completely conventional! To be clear, my prediction is that it can be done with ~zero loss of performance, at inference time only. without being part of training.
Reading other post from this week, it seems likely I was wrong and output is already random enough that the small shift has ~no effect on performance.
OK, I’m glad to hear that my opinion isn’t completely conventional! To be clear, my prediction is that it can be done with ~zero loss of performance, at inference time only. without being part of training.
Reading other post from this week, it seems likely I was wrong and output is already random enough that the small shift has ~no effect on performance.