A model component that converts raw text input into numerical vector representations that capture semantic meaning.
World knowledge accuracy, recall of facts and relationships