Attention, Demystified: From Dot Products to Explaining Transformers
Week 1, Part 1: The Math You Actually Need

Softmax and Turning Scores into Weights

Apply softmax to a vector of raw scores by hand, verify the outputs sum to 1, and explain how scaling scores up or down sharpens or flattens the resulting distribution.