RSS

Sin­gu­lar Learn­ing Theory

TagLast edit: 20 Jun 2023 23:25 UTC by DanielFilan

Singluar learning theory is a theory that applies algebraic geometry to statistical learning theory, developed by Sumio Watanabe. Reference textbooks are “the grey book”, Algebraic Geometry and Statistical Learning Theory, and “the green book”, Mathematical Theory of Bayesian Statistics.

DSLT 0. Distill­ing Sin­gu­lar Learn­ing Theory

Liam Carroll16 Jun 2023 9:50 UTC
64 points
4 comments6 min readLW link

DSLT 1. The RLCT Mea­sures the Effec­tive Di­men­sion of Neu­ral Networks

Liam Carroll16 Jun 2023 9:50 UTC
39 points
8 comments16 min readLW link

DSLT 3. Neu­ral Net­works are Singular

Liam Carroll20 Jun 2023 8:20 UTC
20 points
2 comments19 min readLW link

DSLT 2. Why Neu­ral Net­works obey Oc­cam’s Razor

Liam Carroll18 Jun 2023 0:23 UTC
18 points
14 comments17 min readLW link

Gra­di­ent sur­fing: the hid­den role of regularization

Jesse Hoogland6 Feb 2023 3:50 UTC
33 points
6 comments14 min readLW link
(www.jessehoogland.com)

Spooky ac­tion at a dis­tance in the loss landscape

28 Jan 2023 0:22 UTC
61 points
4 comments7 min readLW link
(www.jessehoogland.com)

Neu­ral net­works gen­er­al­ize be­cause of this one weird trick

Jesse Hoogland18 Jan 2023 0:10 UTC
150 points
26 comments53 min readLW link
(www.jessehoogland.com)

DSLT 4. Phase Tran­si­tions in Neu­ral Networks

Liam Carroll24 Jun 2023 17:22 UTC
27 points
2 comments16 min readLW link

Towards Devel­op­men­tal Interpretability

12 Jul 2023 19:33 UTC
155 points
5 comments9 min readLW link

Ap­ply for the 2023 Devel­op­men­tal In­ter­pretabil­ity Con­fer­ence!

25 Aug 2023 7:12 UTC
30 points
0 comments1 min readLW link

My im­pres­sion of sin­gu­lar learn­ing theory

Ege Erdil18 Jun 2023 15:34 UTC
44 points
29 comments2 min readLW link

In­ter­view Daniel Mur­fet on Univer­sal Phenom­ena in Learn­ing Machines

Alexander Gietelink Oldenziel6 Feb 2023 0:00 UTC
43 points
1 comment16 min readLW link

Open Call for Re­search As­sis­tants in Devel­op­men­tal Interpretability

30 Aug 2023 9:02 UTC
58 points
11 comments4 min readLW link

Sin­gu­lar­i­ties against the Sin­gu­lar­ity: An­nounc­ing Work­shop on Sin­gu­lar Learn­ing The­ory and Alignment

1 Apr 2023 9:58 UTC
86 points
0 comments1 min readLW link
(singularlearningtheory.com)

Jesse Hoogland on Devel­op­men­tal In­ter­pretabil­ity and Sin­gu­lar Learn­ing Theory

Michaël Trazzi6 Jul 2023 15:46 UTC
42 points
2 comments4 min readLW link
(theinsideview.ai)
No comments.