Week 2, Part 1: Attention Itself
Implementing One Attention Head in NumPy
Write a working single-head attention function in ~20 lines of NumPy and verify the attention weight matrix rows sum to 1.
Write a working single-head attention function in ~20 lines of NumPy and verify the attention weight matrix rows sum to 1.