Before dot-product attention, seq2seq models used additive attention: a small network scores how well each encoder state matches the decoder state :
Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.
Start 7-day free trial