A compact numerical representation of text that captures its meaning, allowing the model to compare how similar different pieces of text are to each other.
World knowledge accuracy, recall of facts and relationships