Backpropagation adds every path through a computation
Trace a shared scalar computation, reproduce its gradients, expose a detached branch and distinguish a ReLU kink from a gradient bug.
Foundation
The journal / Ideas in progress
Engineering & everyday learningNotes from
the work.
Software, systems, and the things I’m learning along the way. From first principles to AI in production.
Find something to readAll notes 1
A little theory. A lot of practice.