Logit lens: watch the guess form

Read the model's best guess at every layer, not just the last.

"the cat sat ___"what word fills the blank? watch it decide, layer by layer
layer 1

Early layers guess vaguely; by the top it's confident: on. (8 layers shown — real models have dozens.)