When scaling LLM reasoning at test time without external verifiers, don't just pick the most confident answer; instead, select reasoning paths that show exploratory uncertainty early and convergence to certainty later.
This paper identifies a critical flaw in confidence-based test-time scaling for LLMs: high confidence across all steps often signals failure to explore, leading to confidently wrong answers.