Skip to main content
Search

# Tri-PvP

1 related articles

Subscribe to updates
  1. arXiv

    Tri-PvP's 8,000 tri-modal conflict samples show omni-modal LLMs favor images, and favor perceptual vision but propositional audio

    The authors built Tri-PvP, an 8,000-sample tri-modal conflict benchmark spanning animal, emotion, environment, and music domains in which image and audio each appear in perceptual form (real photographs or recordings) or propositional form (text-card images or TTS speech) while text is always propositional, evaluated five omni-modal LLMs across four evidence-type conditions, and found that image bias dominates in 18 of 20 model-by-condition bars and that a systematic asymmetry exists: models favor perceptual evidence in vision but propositional evidence in audio, with this bias linearly decodable from early hidden layers and only partially mitigated by contrastive decoding, which introduces a residual text bias.

You’re all caught up