Week 2, Part 2: The Full Model and the Explanation
Inside a Transformer Block
Diagram a full block — attention, residual connection, layer norm, feed-forward network — and state the purpose of each residual and normalization step.
Diagram a full block — attention, residual connection, layer norm, feed-forward network — and state the purpose of each residual and normalization step.