Running a Real Model

TinyStories, Traced

• A Real Model, Pinned
• Tokens — Still Exact
• Real Activations
• Real Attention
• Real Logits to the Next Token
• Why You Can't Just Recompute It