Instead of resampling complete reasoning trajectories, you can pinpoint error locations at the step level and only regenerate from there—matching accuracy with significantly lower computational cost.
StepBack improves the efficiency of chain-of-thought reasoning by identifying and resampling only the steps where errors likely occur, rather than regenerating entire reasoning chains. It achieves the same accuracy as standard self-consistency while using up to 41% fewer tokens.