Qwen2 Technical Report
Jul 15, 2024An Yang, Baosong Yang, Binyuan Hui
Alibaba produced a globally competitive open model family — Qwen2 demonstrated that Chinese AI labs can match Western frontier models across languages.
Describes Qwen2, a family of models from 0.5B to 72B trained on 7T tokens across 27 languages. The 72B model matches Llama 3 70B while excelling on multilingual and code tasks.
scalingtrainingmultilingual