OLMoE 1B 7B 0125 Instruct

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released January 20254K context≈ 3,072 words6.9B params

OLMoE is a scrappy, efficient thinker that punches above its weight by routing inputs through a mixture-of-experts architecture — only activating 1B parameters at a time despite having 7B total. It handles general instruction-following competently while keeping compute costs low. Transparency is a core trait: Allen AI releases full training details, making it a rare open-book in a field of closed systems.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Instruction Following

Strong

Creative Writing

OLMoE 1B 7B 0125 Instruct

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released January 20254K context≈ 3,072 words6.9B params

OLMoE is a scrappy, efficient thinker that punches above its weight by routing inputs through a mixture-of-experts architecture — only activating 1B parameters at a time despite having 7B total. It handles general instruction-following competently while keeping compute costs low. Transparency is a core trait: Allen AI releases full training details, making it a rare open-book in a field of closed systems.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Instruction Following

Strong

Creative Writing

Glossary

ArchitectureThe underlying structural design of a neural network that defines how data flows through layers and components.Instruction-FollowingThe ability of a model to understand and execute specific tasks or commands given in natural language prompts.ParametersThe learned numerical values in a model — more parameters generally means more capacity but higher compute cost.RoutingThe mechanism that decides which specialized sub-networks (experts) should process each input in a mixture-of-experts model.TransparencyMaking AI system design, behavior, and decision-making processes visible and understandable to users and regulators.

OLMoE 1B 7B 0125 Instruct

Capabilities

OLMoE 1B 7B 0125 Instruct

Capabilities

Benchmark Scores

Use Case Fit

Glossary