Charles Martin

Karma: 2

Charles Martin 5 Jan 2023 3:20 UTC
3 points
0
on: Basic Facts about Language Model Internals
The PowerLaw behavior has been noted for some time. See https://weightwatcher.ai and the publications in JMLR and Nature Communications.