Stacking the Pieces

A transformer block is a wiring pattern. This lesson shows the components and the order in which data moves through them.

highlighted = computed this step

A transformer block wires attention and an MLP together with residual connections and normalization. The flowchart shows which component feeds which.

\text{input}\rightarrow\text{attention}\rightarrow\text{MLP}\rightarrow\text{output}

The block order

The validated order is input, positional encoding, attention, residual add, layernorm, MLP-ReLU, residual add, layernorm, output.

\text{wiring order is validated}

This lesson is about wiring, not hidden arithmetic. Exact nodes and named-boundary nodes are flagged before any lesson uses the residual example.

\text{flowchart nodes carry exact or named flags}