Numerical representations that capture the meaning of text or audio, allowing the model to understand that similar concepts are close together in this representation space.
World knowledge accuracy, recall of facts and relationships