Attention, Demystified: From Dot Products to Explaining Transformers
Week 2, Part 2: The Full Model and the Explanation

Rehearsing the Explanation

Deliver a five-minute whiteboard explanation of attention using one worked example sentence, and answer three likely follow-up questions (why not RNNs, what the heads learn, why it scales quadratically with sequence length).