Daily Insights

30 Jul 2019 19:29 UTC

Docendo discimus

This sequence recorded my progress learning concepts related to machine learning and AI alignment. With some exceptions, I intended to post an explanation of an important concept every day.

Walkthrough: The Transformer Architecture [Part 1/2]

Matthew Barnett30 Jul 2019 13:54 UTC

35 points

0 comments6 min readLW link

Walkthrough: The Transformer Architecture [Part 2/2]

Matthew Barnett31 Jul 2019 13:54 UTC

13 points

5 comments12 min readLW link

Understanding Batch Normalization

Matthew Barnett1 Aug 2019 17:56 UTC

19 points

3 comments6 min readLW link

Rethinking Batch Normalization

Matthew Barnett2 Aug 2019 20:21 UTC

20 points

5 comments8 min readLW link

A Survey of Early Impact Measures

Matthew Barnett6 Aug 2019 1:22 UTC

29 points

0 comments8 min readLW link

Understanding Recent Impact Measures

Matthew Barnett7 Aug 2019 4:57 UTC

16 points

6 comments7 min readLW link

Four Ways An Impact Measure Could Help Alignment

Matthew Barnett8 Aug 2019 0:10 UTC

21 points

1 comment8 min readLW link

Why Gradients Vanish and Explode

Matthew Barnett9 Aug 2019 2:54 UTC

25 points

9 comments3 min readLW link

A Primer on Matrix Calculus, Part 1: Basic review

Matthew Barnett12 Aug 2019 23:44 UTC

25 points

3 comments7 min readLW link

A Primer on Matrix Calculus, Part 2: Jacobians and other fun

Matthew Barnett15 Aug 2019 1:13 UTC

22 points

7 comments6 min readLW link

A Primer on Matrix Calculus, Part 3: The Chain Rule

Matthew Barnett17 Aug 2019 1:50 UTC

12 points

4 comments6 min readLW link