How big should the batch be? McCandlish et al. (2018) showed that the useful batch size is set by the gradient noise scale
Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.
Start 7-day free trial