A two-agent LLM pipeline can conduct scalable conversational assessments that mimic oral exams by separating the interviewer from the evaluator, reducing cheating risks while maintaining the ability to ask follow-up questions and assess reasoning.
This paper presents an LLM-based system that conducts interactive text-based conversations with students to assess their reasoning and argumentation skills, mimicking oral exams at scale. It uses a two-agent architecture where an interviewer asks questions while a hidden evaluator tracks progress and prevents answer leakage, tested with simulated adversarial students and deployed in a real course.