A sparse mixture-of-experts base model that activates roughly 3 billion parameters per forward pass despite having 48 billion total parameters, keeping inference costs lean while retaining a large parameter pool for knowledge. As a base model, it has no instruction tuning or chat alignment, so it outputs raw continuations rather than structured responses — useful as a foundation for fine-tuning rather than direct conversation.