Popular video generation models systematically fail to match real-world probability distributions—they collapse to a few likely outcomes rather than capturing the full range of possible physical events, which matters for any application requiring accurate uncertainty quantification.
CaliBench tests whether video world models accurately reproduce the probability distributions of physical outcomes.