Decoding

Greedy, Top-k, and the Tree

• From Logits to Tokens
• Greedy Decoding
• Top-k
• Probabilities
• The Decode Tree
• What Decoding Is and Is Not