NeoBERT

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released February 2025context N/A

NeoBERT is a text encoder focused on producing embeddings, operating quietly in the background of NLP pipelines rather than generating conversational output. It follows the BERT-style encoder tradition, taking text in and producing dense vector representations. Details about its specific architectural improvements or training data over baseline BERT variants are limited from available information.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Reasoning & Logic

Moderate

Instruction Following

Moderate

Multilingual

Use Case Fit

Fit scores are AI-generated based on model capabilities, intended use, and technical specifications. Learn more

NeoBERT

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released February 2025context N/A

NeoBERT is a text encoder focused on producing embeddings, operating quietly in the background of NLP pipelines rather than generating conversational output. It follows the BERT-style encoder tradition, taking text in and producing dense vector representations. Details about its specific architectural improvements or training data over baseline BERT variants are limited from available information.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Reasoning & Logic

Moderate

Instruction Following

Moderate

Multilingual

Use Case Fit

Fit scores are AI-generated based on model capabilities, intended use, and technical specifications. Learn more

Glossary

BERTA foundational neural network architecture designed to understand the meaning of words in context by learning from large amounts of text.BERT-Style EncoderA transformer-based model architecture that reads text bidirectionally to understand context and produce meaningful representations of words and sentences.Dense VectorA compact numerical representation where most values are non-zero, used to efficiently store and compare the meaning of text.EmbeddingsNumerical representations of text that capture semantic meaning, allowing the model to measure similarity between different words or phrases.EncoderA model component that transforms input sequences (like protein amino acids) into meaningful numerical representations without generating new sequences.Text EncoderA model component that converts raw text input into numerical vector representations that capture semantic meaning.Training DataThe examples and information used to teach a model how to perform a task, in this case human-written and AI-generated grammatical corrections.

Capabilities

Use Case Fit

Capabilities

Use Case Fit

Similar Models

Glossary