For audio-video generation, evaluating consistency at the event level—rather than treating entire clips as single units—better captures real-world complexity and aligns more closely with human judgment.
This paper introduces AVC-Reward, an event-centric evaluation framework for assessing audio-video consistency in generated content. Unlike existing metrics that treat clips holistically, it breaks down complex scenes into individual audio and visual events, checks their temporal alignment and attribute consistency across modalities, and aggregates results into a three-level metric.