The feed-forward network on one row of 4 numbers. Widen: multiply by W1 to get 8 numbers, each a dot product of the row with one column of W1. Bend: ReLU sets negatives to 0. Narrow: multiply by W2 to get back to 4 numbers. Click a number to see its arithmetic.