Independent AI Research

J Bostock
19 Dec 2021 23:37 UTC

I’m trying my hand at independent AI research. Here are my collected posts about it.

(Banner image source: https://​​www.flickr.com/​​photos/​​fdecomite/​​3237967443/​​ licensed under creative commons)

Mea­sur­ing Learned Op­ti­miza­tion in Small Trans­former Models

J Bostock8 Apr 2024 14:41 UTC
22 points
0 comments11 min readLW link

Differ­en­tial Op­ti­miza­tion Reframes and Gen­er­al­izes Utility-Maximization

J Bostock27 Dec 2023 1:54 UTC
30 points
2 comments3 min readLW link

Model­ling and Un­der­stand­ing SGD

J Bostock5 Oct 2021 13:41 UTC
8 points
0 comments3 min readLW link

SGD Un­der­stood through Prob­a­bil­ity Current

J Bostock19 Dec 2021 23:26 UTC
24 points
1 comment5 min readLW link

Hy­pothe­ses about Find­ing Knowl­edge and One-Shot Causal Entanglements

J Bostock1 Dec 2021 17:01 UTC
16 points
4 comments5 min readLW link