Week 2, Part 1: Attention Itself
Queries, Keys, and Values
Describe the role of Q, K, and V using a retrieval analogy, and state which learned weight matrix produces each from the input embeddings.
Describe the role of Q, K, and V using a retrieval analogy, and state which learned weight matrix produces each from the input embeddings.