A Neural Net You Can Compute by Hand

The Forward Pass

• A Tiny Network
• Weighted Sums
• ReLU
• Output and Loss
• The Computation Graph
• What the Forward Pass Is and Is Not