Carlos Guerrero Alvarez comments on Induction heads—illustrated

[Carlos Guerrero Alvarez]

This is a great explanation of why induction heads need composition of attention heads to happen.