LLMs can recognize that beliefs might change but fail at the harder task of determining what the updated belief should be—they over-update on salient but insufficient evidence, exposing a gap in their theory of mind reasoning.
MuSeToM is a benchmark testing whether large language models can determine when someone should revise their beliefs based on sensory evidence and infer the updated belief state. The benchmark contains 2,415 text-based scenarios with cues from six sensory categories, revealing that models often detect belief changes but struggle to identify what the new belief should be.