Build a Tiny Autograd Engine

hard
Unit 22 · Optimizers0/1 to milestone

PyTorch's loss.backward() works by recording every operation in a graph, then applying the chain rule in reverse. Build a scalar version of that engine.

Pro problem

Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.

Start 7-day free trial
solution.py · Python 3.13
Run your code to see results. ⌘↵ to run · ⌘⇧↵ to submit
Build a Tiny Autograd Engine · TechGradify