Numerical representations of text that capture meaning based on surrounding context, rather than treating each word independently.
World knowledge accuracy, recall of facts and relationships