Joel Grus - Livecoding an Autograd Library - Part 1

Profile Picture
Published on Sep 7, 2018🌏 Public

Do you ever wonder how automatic differentiation libraries work? No? Maybe I'm the only one. Anyway, I'm going to see if I can create one on video and use it to solve some deep learning problems. I have a vague plan of what I intend to accomplish, but this is not a polished or rehearsed performance, so expect some bumps along the way. In part 1, I begin to implement a Tensor class and create a tensor sum function that knows how to differentiate itself. Along the way I demonstrate that I am not all that good at things like pytest and git. code for this part at: