A transformer-based neural network design that learns to understand language by predicting masked words in text, improved upon the original BERT model.
World knowledge accuracy, recall of facts and relationships
Adhering to complex, structured, or constrained instructions