Archive
Sequences
About
Search
Log In
Questions
Events
Shortform
Alignment Forum
AF Comments
Home
Featured
All
Tags
Recent
Comments
leogao comments on
leogao’s Shortform
leogao
27 Feb 2023 22:50 UTC
2
points
GPT-2-xl unembedding matrix looks pretty close to full rank (plot is singular values)
Back to top
GPT-2-xl unembedding matrix looks pretty close to full rank (plot is singular values)