Skip to main content
Search

# VLM Benchmark Auditing

1 related articles

Subscribe to updates
  1. arXiv

    Evaluation runs already leave per-question records: an audit layer reuses them and finds MMStar image zero-gain above a permutation null

    An audit layer added to VLMEvalKit reuses saved per-question outputs from completed evaluations plus one text-only rerun, and on MMStar measures a 20.2% zero-gain share that still exceeds an item-matched permutation null.

You’re all caught up