Assemble a Pre-Norm Transformer Block

medium
Unit 19 · Memory0/2 to milestone

Put the pieces together into one GPT-style pre-norm decoder block for a single sequence x: (T, d):

Pro problem

Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.

Start 7-day free trial
solution.py · Python 3.13
Run your code to see results. ⌘↵ to run · ⌘⇧↵ to submit
Assemble a Pre-Norm Transformer Block · TechGradify