Training a separate verifier to check solutions outperforms just generating more attempts — and GSM8K became the standard benchmark for measuring LLM mathematical reasoning.
Introduces GSM8K, a dataset of 8.5K grade-school math problems, and shows that training verifiers to judge solution correctness is more effective than training generators to produce solutions directly.