the link to fatebook.io at the top does not work.
vyasnikhil96
Karma: 1
- vyasnikhil96Jul 16, 2023, 7:09 PM2 points
2 votes
Overall karma indicates overall quality.
00 votes
Agreement karma indicates agreement, separate from overall quality.
- vyasnikhil96Feb 4, 2023, 1:00 PM1 point
1 vote
Overall karma indicates overall quality.
00 votes
Agreement karma indicates agreement, separate from overall quality.
in reply to: Bill Benzon’s comment on: Large language models learn to represent the worldYour document was very interesting.
1 vote
Overall karma indicates overall quality.
0 votes
Agreement karma indicates agreement, separate from overall quality.
Do you know if the ultra low frequency cluster survives if we do L1/L2 regularization on encoder weights? Similarly I would be curious to know if putting the right sparsity on encoder weights gives a set of neuron sparse features without hurting reconstruction loss or feature sparsity.