You do not need the largest model to get the best results — LLaMA proved that smaller models trained on more tokens outperform larger undertrained ones, and ignited the open-source LLM ecosystem.
Introduces LLaMA, a family of foundation models from 7B to 65B parameters trained on publicly available data. LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, demonstrating that smaller models trained on more data can match much larger ones.