1 · Match: query vs. keys
2 · Mix: weighted average of values
Drag the amber query, or tap the plane. Point it at a key and that word wins. Drag it farther out and every score grows, so softmax snaps onto one word; untick “divide by √d” to see the same thing happen.