It may not quite address many of the particulars you discuss here, but I found myself very convinced by Andrew Gordon Wilson’s Deep Learning is Not So Mysterious or Different (corresponding video), and think it’s going to be well-appreciated by those who appreciate your pair of posts.
It may not quite address many of the particulars you discuss here, but I found myself very convinced by Andrew Gordon Wilson’s Deep Learning is Not So Mysterious or Different (corresponding video), and think it’s going to be well-appreciated by those who appreciate your pair of posts.