Zack_M_Davis answers What’s the theory of impact for activation vectors?

[Zack_M_Davis]

I thought the idea was that steering unsupervisedly-learned abstractions circumvents failure modes of optimizing against human feedback.