Attention, Structurally

Scores, Masks, Softmax

• Attention Scores
• The Causal Mask
• Softmax
• Weighting the Values
• The Attention Grid
• What Attention Is and Is Not