LDL 8: A Silly Realization

Maybe deep learning researchers are just like mathematicians. They think of coding as the hard part of what they do so they spend a lot of time teaching people how to implement neural nets from scratch. But actually the hard part of what they do is math (or at least keeping track of tensor shapes).

So I’m frustrated that I’ve heard a dozen explanations of gradient descent, which I understood in high school, but I have to learn about variational autoencoders from scratch by reading academic papers.