Layer Normalisation

easy
Unit 5 · Losses0/3 to milestone

Transformers normalise each token's feature vector independently with LayerNorm:

Pro problem

Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.

Start 7-day free trial
How LLMs Work· 5 of 19
solution.py · Python 3.13
Run your code to see results. ⌘↵ to run · ⌘⇧↵ to submit
Layer Normalisation · TechGradify