The residual stream
Each block
adds
a nudge — some dims up, some down. The vector
steers
; it doesn't balloon.
if adds only piled up
actual size
‹ Back
Next ›