Numerical representations of text that capture semantic meaning, allowing the model to measure similarity between different words or phrases.
World knowledge accuracy, recall of facts and relationships