LLM2Vec Meta Llama 3 8B Instruct mntp

Llama 3

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released April 20248K context≈ 6,144 words8B params

A specialist that does one thing unusually well: turning text into dense vector representations. Built on Meta's Llama 3 8B Instruct foundation, McGill-NLP has repurposed this instruction-tuned model using a masked next-token prediction approach to produce embeddings rather than generated text. It trades conversational ability entirely for semantic encoding, making it a focused tool rather than a generalist.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Instruction Following

Moderate

Reasoning & Logic

LLM2Vec Meta Llama 3 8B Instruct mntp

Llama 3

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released April 20248K context≈ 6,144 words8B params

A specialist that does one thing unusually well: turning text into dense vector representations. Built on Meta's Llama 3 8B Instruct foundation, McGill-NLP has repurposed this instruction-tuned model using a masked next-token prediction approach to produce embeddings rather than generated text. It trades conversational ability entirely for semantic encoding, making it a focused tool rather than a generalist.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Instruction Following

Moderate

Reasoning & Logic

Glossary

Dense VectorA compact numerical representation where most values are non-zero, used to efficiently store and compare the meaning of text.EmbeddingsNumerical representations of text that capture semantic meaning, allowing the model to measure similarity between different words or phrases.Instruction-TunedA model fine-tuned on instruction-response pairs so it follows user prompts more reliably.Masked Next-Token PredictionA training technique where parts of text are hidden and the model learns to predict what should fill those gaps, helping it understand context and meaning.Next-Token PredictionThe fundamental task where a language model learns to guess the most likely next word (or token) based on all the words that came before it.Semantic EncodingThe process of converting the meaning of text into numerical vectors that preserve relationships between similar concepts.TokenA small unit of text (a word, subword, or punctuation mark) that a language model breaks input into for processing.Token PredictionThe core task of predicting what word or subword (token) should come next in a sequence based on previous text.

Capabilities

Capabilities

Use Case Fit

Glossary