An encoder can read both earlier and later words. Here later context changes illustrative attention at “it”. A causal decoder cannot do this at that earlier position.
Hand-chosen weights for a bidirectional encoder, not measurements from a trained model. The example illustrates how later context can favor a referent: “it” attends back to the nouns it might refer to (here chicken and road), and context tips the balance.