interstice comments on NTK/​GP Models of Neural Nets Can’t Learn Features

[interstice]

Yes, and indeed in the NTK limit we can model ordinary training that way.