A new category token uses the pinned other-column policy.

highlighted = computed this step

Show the new token

Row D has color yellow. Yellow is not in the pinned known list red, blue, green.

Dcolor=yellowD_{\text{color}}=\text{yellow}
Unknown Category PolicyExact other-column policy for a new category token.unknown category uses other columnrowcolorredbluegreenotherAred1000Bblue0100Cgreen0010Dyellow0001unknown category to other columnpreprocessing rewrites category tokens into indicator columnsunknown category uses the pinned other-column policyNOT training; NOT learning; NOT generalizationNOT accuracy; NOT calibration; NOT a guarantee of model qualityNOT probability truth

Apply the stated policy

The policy is pinned: unknown category goes to the other column. Row D becomes red 0, blue 0, green 0, other 1.

Dyellow=(0,0,0,1)D_{\text{yellow}}=(0,0,0,1)
Unknown Category PolicyExact other-column policy for a new category token.unknown category uses other columnrowcolorredbluegreenotherAred1000Bblue0100Cgreen0010Dyellow0001unknown category to other columnpreprocessing rewrites category tokens into indicator columnsunknown category uses the pinned other-column policyNOT training; NOT learning; NOT generalizationNOT accuracy; NOT calibration; NOT a guarantee of model qualityNOT probability truth

The unknown policy is not implicit

The lesson chooses the other-column policy before encoding. A different policy would be a different pinned lesson.

unknown categoryother column\text{unknown category}\rightarrow\text{other column}
Unknown Category PolicyExact other-column policy for a new category token.unknown category uses other columnrowcolorredbluegreenotherAred1000Bblue0100Cgreen0010Dyellow0001unknown category to other columnpreprocessing rewrites category tokens into indicator columnsunknown category uses the pinned other-column policyNOT training; NOT learning; NOT generalizationNOT accuracy; NOT calibration; NOT a guarantee of model qualityNOT probability truth