Numerical encodings of text that capture meaning based on surrounding words, allowing downstream tasks to understand nuanced language.
World knowledge accuracy, recall of facts and relationships
Adhering to complex, structured, or constrained instructions