The finale explains the new verification standard. Rounded page values are not enough; real traces are checked by deterministic re-execution and raw-byte hash locks.

highlighted = computed this step

Why you can't just recompute it

The rounded values on the page are for inspection. Hand-recomputing from those rounded views does not reproduce the captured run, because display precision is not compute precision and floating-point arithmetic order matters.

rounded displaythe captured tensor bytes\text{rounded display}\ne\text{the captured tensor bytes}
Why rounded floats are not enoughRe-execution and hashes replace hand recomputation.Why rounded floats are not enoughRe-execution and hashes replace hand recomputation.run manifestmodel:roneneldan/TinyStories-1Mrevision:77f1b168e219585646439073245fe87e56b3023eimage digest:sha256:ba5614c41210ecdd54f73903dacbb0110672c0f848faf93cf0937da0ee0d2293trace hash:b5aca0aae10fa6029ca1a09e8ae9e1fe1d120cf85b4d9371396fee78398c29c6prompt:'Once upon a time'seed:12345output text:'Once upon a time, there was'repro:docker run --rm --network none -e REALTRACE_IMAGE_DIGEST=$IMAGE_ID -v $OUT:/out egtry-realtrace:bookb-spike --local-files-only --out /out/run1hash locks raw tensor bytes + shape/dtype/seed/env/image digest; not rounded decimalsdiscrete token spineprompt: 'Once upon a time'prompt token IDs = [7454, 2402, 257, 640]output token IDs = [7454, 2402, 257, 640, 11, 612, 373]greedy exact: step 0: id 11 text ',' | step 1: id 612 text ' there' | step 2: id 373 text ' was'real output text = 'Once upon a time, there was'captured embedding cellsCaptured embedding stream cells for prompt token 0.tensor: step00.hidden_state_00 shape [1, 4, 64]hidden_state_00 token0 dim0≈0.268982captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim1≈-0.219411captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim2≈-0.151322captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim3≈0.0356655captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim4≈0.133395captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim5≈0.0172995captured fp32, shown to 6 sig-digitsall visible magnitudes are read from captured fp32 tensor cellsattention head heatmapCaptured attention weights: step 0, layer 0, head 0.tensor: step00.attention_00 shape [1, 16, 4, 4] | every q,k cell displayedk0k1k2k3q0≈1q0->k0≈0q0->k1≈0q0->k2≈0q0->k3q1≈0.479708q1->k0≈0.520292q1->k1≈0q1->k2≈0q1->k3q2≈0.30865q2->k0≈0.161946q2->k1≈0.529404q2->k2≈0q2->k3q3≈0.220487q3->k0≈0.199623q3->k1≈0.403692q3->k2≈0.176197q3->k3captured fp32, shown to 6 sig-digitsno attention weight is omitted; colors are distilled display metadata, values are captured cellscaptured logits to exact greedyCaptured final-step top logits and exact greedy pick.tensor: step02.logits_last shape [1, 50257]ranktoken idlogitprecision1373≈19.3264captured fp32, shown to 6 sig-digits2547≈15.4883captured fp32, shown to 6 sig-digits35615≈14.7227captured fp32, shown to 6 sig-digits411≈11.5574captured fp32, shown to 6 sig-digits5318≈11.2361captured fp32, shown to 6 sig-digitsexact greedy argmax token id = 373 text ' was'final output text = 'Once upon a time, there was'; output IDs = [7454, 2402, 257, 640, 11, 612, 373]

Verify by re-execution

The practical check is to rerun the pinned image and compare the raw trace hash. If the trace hash matches, the captured tensor bytes and the displayed cells have a provenance path.

pinned image rerunmatching trace hash\text{pinned image rerun}\rightarrow\text{matching trace hash}
Why rounded floats are not enoughRe-execution and hashes replace hand recomputation.Why rounded floats are not enoughRe-execution and hashes replace hand recomputation.run manifestmodel:roneneldan/TinyStories-1Mrevision:77f1b168e219585646439073245fe87e56b3023eimage digest:sha256:ba5614c41210ecdd54f73903dacbb0110672c0f848faf93cf0937da0ee0d2293trace hash:b5aca0aae10fa6029ca1a09e8ae9e1fe1d120cf85b4d9371396fee78398c29c6prompt:'Once upon a time'seed:12345output text:'Once upon a time, there was'repro:docker run --rm --network none -e REALTRACE_IMAGE_DIGEST=$IMAGE_ID -v $OUT:/out egtry-realtrace:bookb-spike --local-files-only --out /out/run1hash locks raw tensor bytes + shape/dtype/seed/env/image digest; not rounded decimalsdiscrete token spineprompt: 'Once upon a time'prompt token IDs = [7454, 2402, 257, 640]output token IDs = [7454, 2402, 257, 640, 11, 612, 373]greedy exact: step 0: id 11 text ',' | step 1: id 612 text ' there' | step 2: id 373 text ' was'real output text = 'Once upon a time, there was'captured embedding cellsCaptured embedding stream cells for prompt token 0.tensor: step00.hidden_state_00 shape [1, 4, 64]hidden_state_00 token0 dim0≈0.268982captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim1≈-0.219411captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim2≈-0.151322captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim3≈0.0356655captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim4≈0.133395captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim5≈0.0172995captured fp32, shown to 6 sig-digitsall visible magnitudes are read from captured fp32 tensor cellsattention head heatmapCaptured attention weights: step 0, layer 0, head 0.tensor: step00.attention_00 shape [1, 16, 4, 4] | every q,k cell displayedk0k1k2k3q0≈1q0->k0≈0q0->k1≈0q0->k2≈0q0->k3q1≈0.479708q1->k0≈0.520292q1->k1≈0q1->k2≈0q1->k3q2≈0.30865q2->k0≈0.161946q2->k1≈0.529404q2->k2≈0q2->k3q3≈0.220487q3->k0≈0.199623q3->k1≈0.403692q3->k2≈0.176197q3->k3captured fp32, shown to 6 sig-digitsno attention weight is omitted; colors are distilled display metadata, values are captured cellscaptured logits to exact greedyCaptured final-step top logits and exact greedy pick.tensor: step02.logits_last shape [1, 50257]ranktoken idlogitprecision1373≈19.3264captured fp32, shown to 6 sig-digits2547≈15.4883captured fp32, shown to 6 sig-digits35615≈14.7227captured fp32, shown to 6 sig-digits411≈11.5574captured fp32, shown to 6 sig-digits5318≈11.2361captured fp32, shown to 6 sig-digitsexact greedy argmax token id = 373 text ' was'final output text = 'Once upon a time, there was'; output IDs = [7454, 2402, 257, 640, 11, 612, 373]

Summary

This is a real model's actual computation captured honestly: the discrete spine is exact, and the continuous magnitudes are REAL CAPTURED floats shown with approximate labels. It is not exact arithmetic, not invented, not learning, not meaning, and not understanding. The bar moved from pure pedagogical exactness to practical but honest captured execution.

exact discrete spine plus REAL CAPTURED magnitudes\text{exact discrete spine plus REAL CAPTURED magnitudes}
Why rounded floats are not enoughRe-execution and hashes replace hand recomputation.Why rounded floats are not enoughRe-execution and hashes replace hand recomputation.run manifestmodel:roneneldan/TinyStories-1Mrevision:77f1b168e219585646439073245fe87e56b3023eimage digest:sha256:ba5614c41210ecdd54f73903dacbb0110672c0f848faf93cf0937da0ee0d2293trace hash:b5aca0aae10fa6029ca1a09e8ae9e1fe1d120cf85b4d9371396fee78398c29c6prompt:'Once upon a time'seed:12345output text:'Once upon a time, there was'repro:docker run --rm --network none -e REALTRACE_IMAGE_DIGEST=$IMAGE_ID -v $OUT:/out egtry-realtrace:bookb-spike --local-files-only --out /out/run1hash locks raw tensor bytes + shape/dtype/seed/env/image digest; not rounded decimalsdiscrete token spineprompt: 'Once upon a time'prompt token IDs = [7454, 2402, 257, 640]output token IDs = [7454, 2402, 257, 640, 11, 612, 373]greedy exact: step 0: id 11 text ',' | step 1: id 612 text ' there' | step 2: id 373 text ' was'real output text = 'Once upon a time, there was'captured embedding cellsCaptured embedding stream cells for prompt token 0.tensor: step00.hidden_state_00 shape [1, 4, 64]hidden_state_00 token0 dim0≈0.268982captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim1≈-0.219411captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim2≈-0.151322captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim3≈0.0356655captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim4≈0.133395captured fp32, shown to 6 sig-digitshidden_state_00 token0 dim5≈0.0172995captured fp32, shown to 6 sig-digitsall visible magnitudes are read from captured fp32 tensor cellsattention head heatmapCaptured attention weights: step 0, layer 0, head 0.tensor: step00.attention_00 shape [1, 16, 4, 4] | every q,k cell displayedk0k1k2k3q0≈1q0->k0≈0q0->k1≈0q0->k2≈0q0->k3q1≈0.479708q1->k0≈0.520292q1->k1≈0q1->k2≈0q1->k3q2≈0.30865q2->k0≈0.161946q2->k1≈0.529404q2->k2≈0q2->k3q3≈0.220487q3->k0≈0.199623q3->k1≈0.403692q3->k2≈0.176197q3->k3captured fp32, shown to 6 sig-digitsno attention weight is omitted; colors are distilled display metadata, values are captured cellscaptured logits to exact greedyCaptured final-step top logits and exact greedy pick.tensor: step02.logits_last shape [1, 50257]ranktoken idlogitprecision1373≈19.3264captured fp32, shown to 6 sig-digits2547≈15.4883captured fp32, shown to 6 sig-digits35615≈14.7227captured fp32, shown to 6 sig-digits411≈11.5574captured fp32, shown to 6 sig-digits5318≈11.2361captured fp32, shown to 6 sig-digitsexact greedy argmax token id = 373 text ' was'final output text = 'Once upon a time, there was'; output IDs = [7454, 2402, 257, 640, 11, 612, 373]