jsd

• jsdOct 21, 2021, 4:18 PM

  LW: 4 AF: 3

  AF

  in reply to: Jsevillamol’s comment on: Emer­gent mod­u­lar­ity and safety

  Relevant related work : NNs are surprisingly modular

  https://​​arxiv.org/​​abs/​​2003.04881v2?ref=mlnew

  I believe Richard linked to Clusterability in Neural Networks, which has superseded Pruned Neural Networks are Surprisingly Modular.

  The same authors also recently published Detecting Modularity in Deep Neural Networks.

• jsdOct 21, 2021, 4:13 PM

  5 points

  on: Emer­gent mod­u­lar­ity and safety

  On one hand, Olah et al.’s (2020) investigations find circuits which implement human-comprehensible functions.

  At a higher level, they also find that different branches (when the modularity is enforced already by the architecture) tend to contain different features.

• jsdSep 4, 2021, 5:05 PM

  7 points

  on: 18 pos­si­ble mean­ings of “I Like Red”

  Another meaning could be: I want to raise the salience of the issue ‘Red vs Not Red’, I want to convey that ‘Red vs Not Red’ is an underrated axis. I think this is also an example of level 4?