This is quite an interesting way to do OOD-detection. Instead of measuring statistics on the original model’s activations, you run it on two models and see if there’s a diff in reconstruction.
Would be interesting to compare against those baselines.
I don’t even think this would naively be twice as expensive, since you can wait until after Original model finishes generating before running the Finetuned model.
This is quite an interesting way to do OOD-detection. Instead of measuring statistics on the original model’s activations, you run it on two models and see if there’s a diff in reconstruction.
Would be interesting to compare against those baselines.
I don’t even think this would naively be twice as expensive, since you can wait until after Original model finishes generating before running the Finetuned model.