Wiring the Block

The Full Block Flowchart

The full flowchart shows the exact and named registers together. It also repeats the residual-add example as a checkable exact calculation inside the larger block structure.

highlighted = computed this step

The full block flowchart

The full diagram puts the exact and named registers together. Residual add and MLP-ReLU are exact; positional encoding, attention, and layernorm are named. Seeing them in one flowchart is the point: the block is a wiring pattern with boundaries, not one undifferentiated box.

exact nodes+named nodes\text{exact nodes}+\text{named nodes}
Transformer block honestyWiring exact; named components flagged.Transformer block honestyWiring exact; named components flagged.transformer block wiringwiring is exact; named components carry no numeric outputinput hexactdisplayed vector+ positional encodingnamed (sin/cos)attentionnamed (softmax)residual addexactvector additionlayernormnamed (√)MLP-ReLUexactrational ReLU wiringresidual addexactvector additionlayernormnamed (√)outputexactresidual example: h=(2,3) + s=(1,-1) = (3,2)exact residual adddisplayed vectors are exact integers; sum is recomputedh=(2,3)+s=(1,-1)=r=(3,2)

Residual add inside the block

The residual example remains (2,3) plus (1,-1) equals (3,2). The same exact add is shown below the flowchart to anchor the abstract wiring in one checkable vector operation.

(2,3)+(1,−1)=(3,2)(2,3)+(1,-1)=(3,2)
Transformer block honestyWiring exact; named components flagged.Transformer block honestyWiring exact; named components flagged.transformer block wiringwiring is exact; named components carry no numeric outputinput hexactdisplayed vector+ positional encodingnamed (sin/cos)attentionnamed (softmax)residual addexactvector additionlayernormnamed (√)MLP-ReLUexactrational ReLU wiringresidual addexactvector additionlayernormnamed (√)outputexactresidual example: h=(2,3) + s=(1,-1) = (3,2)exact residual adddisplayed vectors are exact integers; sum is recomputedh=(2,3)+s=(1,-1)=r=(3,2)

Summary

The complete block is a wiring diagram with validated flags. Named components carry no numeric output in the diagram, and exact components show only values that can be recomputed from displayed inputs.

named nodes have no pinned floats\text{named nodes have no pinned floats}
Transformer block honestyWiring exact; named components flagged.Transformer block honestyWiring exact; named components flagged.transformer block wiringwiring is exact; named components carry no numeric outputinput hexactdisplayed vector+ positional encodingnamed (sin/cos)attentionnamed (softmax)residual addexactvector additionlayernormnamed (√)MLP-ReLUexactrational ReLU wiringresidual addexactvector additionlayernormnamed (√)outputexactresidual example: h=(2,3) + s=(1,-1) = (3,2)exact residual adddisplayed vectors are exact integers; sum is recomputedh=(2,3)+s=(1,-1)=r=(3,2)