Joel Grus - Livecoding an Autograd Library - Part 2
In part 2, we implement the ability to add two tensors. It's harder than it sounds! In the process we go deep into the weeds of tensor broadcasting, and I spend way too much time hunting down a stupid bug. code at: https://github.com/joelgrus/autograd/...