Nadam: Adam with Nesterov Momentum

medium
Unit 15 · Learning Rate & Optimizers0/2 to milestone

Nadam applies Nesterov's look-ahead to Adam's first moment. A common simplified form at step tt (1-based):

Pro problem

Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.

Start 7-day free trial
solution.py · Python 3.13
Run your code to see results. ⌘↵ to run · ⌘⇧↵ to submit
Nadam: Adam with Nesterov Momentum · TechGradify