A transformer-based model architecture that reads text bidirectionally to understand context and produce meaningful representations of words and sentences.