Charles Martin comments on Basic Facts about Language Model Internals

Charles Martin 5 Jan 2023 3:20 UTC
3 points
0
The PowerLaw behavior has been noted for some time. See https://weightwatcher.ai and the publications in JMLR and Nature Communications.