[CLS], [SEP] & Next Sentence Prediction
One pair, two sentences. Does B really follow A? The [CLS] slot decides.
Real next pair
Random pair
Sentence A (segment 0)
Sentence B (segment 1)
[CLS] · pair summary