Gradient Descent, One Step

One Exact Step

• Gradients Point Downhill
• The Update Rule
• One Exact Step
• The Updated Network
• Choosing the Step Size
• Same Gradient, Different Eta
• What One Step Is and Is Not