A numerical encoding of text where similar meanings are positioned close together in mathematical space, enabling the model to understand relationships between concepts.
World knowledge accuracy, recall of facts and relationships