At inference, batch norm uses fixed running statistics, so it's just an affine transform and can be folded into the preceding layer:
Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.
Start 7-day free trial