To steer aforward pass with the “wedding” vector, we start running an ordinary GPT-2-XL forward pass on the prompt “I love dogs” until layer 6. Right before layer 6 begins, we now add in the cached residual stream vectors from before:
I have a question about the image above this text.
Why do you add the embedding from the [<endofotext> → “The”] stream? This part has no information about wedding.
I have a question about the image above this text.
Why do you add the embedding from the [<endofotext> → “The”] stream? This part has no information about wedding.