Relevant related work : NNs are surprisingly modular
https://arxiv.org/abs/2003.04881v2?ref=mlnews
On the topic of pruning neural networks, see the lottery ticket hypothesis
https://arxiv.org/abs/1803.03635
Relevant related work : NNs are surprisingly modularhttps://arxiv.org/abs/2003.04881v2?ref=mlnew
https://arxiv.org/abs/2003.04881v2?ref=mlnew
I believe Richard linked to Clusterability in Neural Networks, which has superseded Pruned Neural Networks are Surprisingly Modular.
The same authors also recently published Detecting Modularity in Deep Neural Networks.
It’s true! Altho I think of putting something up on arXiv as a somewhat lower bar than ‘publication’ - that paper has a bit of work left.
Relevant related work : NNs are surprisingly modular
https://arxiv.org/abs/2003.04881v2?ref=mlnews
On the topic of pruning neural networks, see the lottery ticket hypothesis
https://arxiv.org/abs/1803.03635
I believe Richard linked to Clusterability in Neural Networks, which has superseded Pruned Neural Networks are Surprisingly Modular.
The same authors also recently published Detecting Modularity in Deep Neural Networks.
It’s true! Altho I think of putting something up on arXiv as a somewhat lower bar than ‘publication’ - that paper has a bit of work left.