principles.fyi · Topic
The other half of the transformer family: BERT-style encoders that read both directions to understand text — fill-in-the-blank training, word senses, and tagging.