alexandraabbas comments on Latent Adversarial Training (LAT) Improves the Representation of Refusal

[alexandraabbas]

Yes! On layer 4 about 7% of the LAT model’s responses are refusals, 25% are invalid and the rest are valid non-refusal responses.