Use value-of-information theory to decide when to invest in expensive model quality estimates before routing—this cuts estimation costs dramatically while maintaining routing accuracy.
This paper solves the problem of efficiently routing queries to the best AI model in a system with multiple specialists. The key challenge: estimating which model will perform best costs money (slow but accurate estimators vs. fast but noisy ones).