A step-through of one transformer block on three tokens, showing attention mixing rows then the feed-forward network detecting and recalling per token.

One transformer block, step by step

Gather from the other tokens, then think alone — same shape out as in.

positive value negative value zeroed by ReLU
Active stage of the transformer block Grid of token vectors transforming through attention and the feed-forward network.