Phone-sized models can rival GPT-3.5 — Phi-3 proved that data curation and filtering are as important as scale for practical deployment.
Presents Phi-3, a 3.8B model that rivals Mixtral 8x7B and GPT-3.5 through carefully curated training data. Demonstrates that small models with high-quality data can run locally on phones while matching much larger models.