Joel Grus - Livecoding an Autograd Library - Part 1
Do you ever wonder how automatic differentiation libraries work? No? Maybe I'm the only one. Anyway, I'm going to see if I can create one on video and use it to solve some deep learning problems. I have a vague plan of what I intend to accomplish, but this is not a polished or rehearsed performance, so expect some bumps along the way. In part 1, I begin to implement a
Tensor class and create a tensor
sum function that knows how to differentiate itself. Along the way I demonstrate that I am not all that good at things like pytest and git. code for this part at: https://github.com/joelgrus/autograd/...