I’ve not mentally carved things up that way before, but they do seem like different flavors of work (with 1 and 2 being closely related).
Another distinction I sometimes consider is between exploring a network for interpretable pieces (“finding things we understand”) versus trying to exhaustively interpret part of a network (“finding things we don’t understand”). But this distinction doesn’t carve up existing work very evenly: the only thing I can think of that I’d put in the latter category is the work on Artificial Artificial Neural Networks.
I’ve not mentally carved things up that way before, but they do seem like different flavors of work (with 1 and 2 being closely related).
Another distinction I sometimes consider is between exploring a network for interpretable pieces (“finding things we understand”) versus trying to exhaustively interpret part of a network (“finding things we don’t understand”). But this distinction doesn’t carve up existing work very evenly: the only thing I can think of that I’d put in the latter category is the work on Artificial Artificial Neural Networks.