Mechanistic interpretability tools can identify hallucination signals in LLM agents but struggle to provide robust, complete explanations because agent failures involve distributed computations that vary across examples and are sensitive to superficial prompt changes.
This paper investigates whether mechanistic interpretability—techniques for understanding LLM internals—can explain why AI agents hallucinate unavailable web actions.