When a model produces contradictory predictions for the same concept represented in different modalities.