OLMoE 1B 7B 0924

OLMoE is a scrappy, efficient mixture-of-experts model that punches above its weight by activating only 1B parameters per forward pass despite having 7B total. It handles general language tasks with reasonable competence while keeping inference costs low. Fully open-weight under Apache 2.0, it's transparent about its architecture in a way most models aren't.