Highly underrated post!
You scale dimension 447 (the largest), because you hypothesize that it is correlated with the bos token since it has the largest activation?
Highly underrated post!
You scale dimension 447 (the largest), because you hypothesize that it is correlated with the bos token since it has the largest activation?