OpenHermes 2.5 is a fine-tuned Mistral 7B that leans heavily into instruction-following and chat, trained almost entirely on synthetic data generated by GPT-4. It punches above its weight class for coding, reasoning, and structured responses, often feeling more coherent than its parameter count suggests. The trade-off is that its personality and knowledge are shaped by its synthetic training diet, which can occasionally surface GPT-like patterns or gaps in real-world grounding.
| Benchmark | Score | Type | Recorded |
|---|---|---|---|
| IFEval | 55.7 | accuracy | 4d ago |