Even state-of-the-art language models make critical errors on specialized medical physics calculations—including omitting standard corrections—and show inconsistent error detection, suggesting LLMs need domain-specific verification before deployment in clinical settings where calculation mist...
MedPhysBench is a benchmark with 1,200 test items evaluating how well language models perform medical physics calculations and error detection across radiation therapy, imaging, and nuclear medicine.