Cost-Aware Abstention for LLM-Based IT Ticket Classification

Key Takeaway

For high-stakes classification tasks like IT ticket routing, knowing when to abstain and defer to humans is more valuable than always routing automatically—and simpler models with proper calibration often outperform LLMs when costs of errors are asymmetric.