Week 2, Part 2: The Full Model and the Explanation
Multi-Head Attention
Explain why multiple heads with smaller d_k are used instead of one large head, and trace how head outputs are concatenated and projected back to d_model.
Explain why multiple heads with smaller d_k are used instead of one large head, and trace how head outputs are concatenated and projected back to d_model.