jsd

“Ac­qui­si­tion of Chess Knowl­edge in AlphaZero”: prob­ing AZ over time

• jsd 21 Oct 2021 16:18 UTC

  LW: 4 AF: 3

  AF

  in reply to: Jsevillamol’s comment on: Emer­gent mod­u­lar­ity and safety

  Relevant related work : NNs are surprisingly modular

  https://​​arxiv.org/​​abs/​​2003.04881v2?ref=mlnew

  I believe Richard linked to Clusterability in Neural Networks, which has superseded Pruned Neural Networks are Surprisingly Modular.

  The same authors also recently published Detecting Modularity in Deep Neural Networks.

• jsd 21 Oct 2021 16:13 UTC

  5 points

  on: Emer­gent mod­u­lar­ity and safety

  On one hand, Olah et al.’s (2020) investigations find circuits which implement human-comprehensible functions.

  At a higher level, they also find that different branches (when the modularity is enforced already by the architecture) tend to contain different features.

• jsd 4 Sep 2021 17:05 UTC

  7 points

  on: 18 pos­si­ble mean­ings of “I Like Red”

  Another meaning could be: I want to raise the salience of the issue ‘Red vs Not Red’, I want to convey that ‘Red vs Not Red’ is an underrated axis. I think this is also an example of level 4?