Breaking math reasoning into specialized expert modules and routing problems to appropriate skill combinations outperforms monolithic approaches—AMR improves math accuracy by 3-5% on benchmark tasks by matching problems to their required reasoning skills.
This paper proposes Atomic MathReasoner (AMR), a framework that decomposes mathematical reasoning into specialized skills and learns to compose them for different problems. Rather than training one general math model, AMR creates expert modules for specific reasoning abilities, then uses a lightweight router to select the right combination of experts for each problem at inference time.