Related: “To what extent does Veit et al still hold on transformer LMs?” feels to me a super tractable and pretty helpful paper someone could work on (Anthropic do some experiments but not many). People discuss this paper a lot with regard to NNs having a simplicity bias, as well as how the paper implies NNs are really stacks of many narrow heuristics rather than deep paths. Obviously empirical work won’t provide crystal clear answers to these questions but this doesn’t mean working on this sort of thing isn’t valuable.
Related: “To what extent does Veit et al still hold on transformer LMs?” feels to me a super tractable and pretty helpful paper someone could work on (Anthropic do some experiments but not many). People discuss this paper a lot with regard to NNs having a simplicity bias, as well as how the paper implies NNs are really stacks of many narrow heuristics rather than deep paths. Obviously empirical work won’t provide crystal clear answers to these questions but this doesn’t mean working on this sort of thing isn’t valuable.