Wiring the Block

The Full Block Flowchart

The full flowchart shows the exact and named registers together. It also repeats the residual-add example as a checkable exact calculation.

highlighted = computed this step

The full block flowchart

The full diagram puts the exact and named registers together. Residual add and MLP-ReLU are exact; positional encoding, attention, and layernorm are named.

exact nodes+named nodes\text{exact nodes}+\text{named nodes}
Transformer block honestyWiring exact; named components flagged.Transformer block honestyWiring exact; named components flagged.transformer block wiringwiring is exact; named components carry no numeric outputinput hexactdisplayed vector+ positional encodingnamed (sin/cos)attentionnamed (softmax)residual addexactvector additionlayernormnamed (√)MLP-ReLUexactrational ReLU wiringresidual addexactvector additionlayernormnamed (√)outputexactresidual example: h=(2,3) + s=(1,-1) = (3,2)exact residual adddisplayed vectors are exact integers; sum is recomputedh=(2,3)+s=(1,-1)=r=(3,2)

Residual add inside the block

The residual example remains (2,3) plus (1,-1) equals (3,2). The same exact add is shown below the flowchart.

(2,3)+(1,−1)=(3,2)(2,3)+(1,-1)=(3,2)
Transformer block honestyWiring exact; named components flagged.Transformer block honestyWiring exact; named components flagged.transformer block wiringwiring is exact; named components carry no numeric outputinput hexactdisplayed vector+ positional encodingnamed (sin/cos)attentionnamed (softmax)residual addexactvector additionlayernormnamed (√)MLP-ReLUexactrational ReLU wiringresidual addexactvector additionlayernormnamed (√)outputexactresidual example: h=(2,3) + s=(1,-1) = (3,2)exact residual adddisplayed vectors are exact integers; sum is recomputedh=(2,3)+s=(1,-1)=r=(3,2)

Summary

The complete block is a wiring diagram with validated flags. Named components carry no numeric output in the diagram.

named nodes have no pinned floats\text{named nodes have no pinned floats}
Transformer block honestyWiring exact; named components flagged.Transformer block honestyWiring exact; named components flagged.transformer block wiringwiring is exact; named components carry no numeric outputinput hexactdisplayed vector+ positional encodingnamed (sin/cos)attentionnamed (softmax)residual addexactvector additionlayernormnamed (√)MLP-ReLUexactrational ReLU wiringresidual addexactvector additionlayernormnamed (√)outputexactresidual example: h=(2,3) + s=(1,-1) = (3,2)exact residual adddisplayed vectors are exact integers; sum is recomputedh=(2,3)+s=(1,-1)=r=(3,2)