Evaluating mental health AI requires both interpretable rubrics from domain experts and realistic patient simulations; current models' biggest weakness is misjudging how much guidance to give in different situations.
MindEval2 is an evaluation framework for testing how well AI chatbots provide mental health support. It includes clinician-designed rubrics that break down response quality into clear, actionable criteria, and a realistic patient simulator with memory that tracks conversations over time.