cfoster0 comments on Steering GPT-2-XL by adding an activation vector

[cfoster0]

I wonder if this is related to how GPT-J runs the attention and MLP sublayers in parallel, as opposed to sequentially?