gpt neox 20b

Name: gpt neox 20b
Author: EleutherAI

by EleutherAIGPT-Neo

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released April 20222K context≈ 1,536 words20.7B params

GPT-NeoX-20B is a straightforward, no-frills text generator that reflects EleutherAI's commitment to open research. It handles general language tasks competently but can feel rough around the edges compared to instruction-tuned contemporaries — it's a base model, so it completes text rather than following instructions. Think of it as a capable foundation that needs fine-tuning to really shine in applied settings.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Instruction Following

Basic

Tool Use

gpt neox 20b

by EleutherAIGPT-Neo

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released April 20222K context≈ 1,536 words20.7B params

GPT-NeoX-20B is a straightforward, no-frills text generator that reflects EleutherAI's commitment to open research. It handles general language tasks competently but can feel rough around the edges compared to instruction-tuned contemporaries — it's a base model, so it completes text rather than following instructions. Think of it as a capable foundation that needs fine-tuning to really shine in applied settings.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Instruction Following

Basic

Tool Use

Glossary

Base ModelA pretrained model that completes text patterns but hasn't been trained to follow instructions, serving as a starting point for customization through fine-tuning.Fine-TuningThe process of further training a pre-trained model on new data to adapt it for specific tasks or domains.GPT-NeoXAn open-source large language model architecture based on the GPT design, created as an alternative to closed-source models.Instruction-TunedA model fine-tuned on instruction-response pairs so it follows user prompts more reliably.

gpt neox 20b

Capabilities

gpt neox 20b

Capabilities

Benchmark Scores

Use Case Fit

Glossary