Archive
Sequences
About
Search
Log In
Questions
Events
Shortform
Alignment Forum
AF Comments
Home
Featured
All
Tags
Recent
Comments
RSS
Carlos Guerrero Alvarez
Karma:
8
All
Posts
Comments
New
Top
Old
Carlos Guerrero Alvarez
16 Jun 2026 18:12 UTC
1
point
0
on:
Induction heads—illustrated
This is a great explanation of why induction heads need composition of attention heads to happen.
1 Layer Induction Heads and Some Research
Goutham Nalagatla
and
Carlos Guerrero Alvarez
16 Jun 2026 18:09 UTC
10
points
2
comments
14
min read
LW
link
Back to top
This is a great explanation of why induction heads need composition of attention heads to happen.