A numerical encoding that captures the meaning and context of text rather than just its surface-level words, enabling the model to understand that similar concepts have similar representations.
World knowledge accuracy, recall of facts and relationships
Quality of non-English language understanding and generation