Reverse-mode automatic differentiation

Backpropagation on a computational graph

f(x,y) = (x·y 1)2 + (x 2)2

Computational graph idle

epoch 1 step 0 / 16 ready
Press Step to run the forward pass, then backprop, then one gradient-descent update.

Loss landscape & descent ∇f as an arrow

trajectory / point (x, y) −∇f (descent direction) minimum (2, 0.5)