Skip to main content
Search

# Frontier General-Purpose Vision Evaluation

1 related articles

Subscribe to updates
  1. arXiv

    MBZUAI team evaluates GPT-6 Astra and five other general systems across 34 capabilities and 55 benchmarks, finding semantic understanding near reference levels while precise geometry and faithful reconstruction remain gaps

    Researchers at MBZUAI and Apertix placed GPT-6 Astra alongside Fable 5, Kimi K3, Gemini 3.1 Pro, Qwen 3.8-Max, and Muse Spark 1.3 under identical instructions, inputs, and scoring across 34 capabilities, 55 benchmarks, and nine areas of computer vision, comparing them with dedicated models and humans, and found that semantic interpretation, reasoning, and object-centric prediction approach or reach reference levels while metric geometric accuracy, faithful reconstruction, temporally consistent dense prediction, and specialized fine-grained visual knowledge retain larger gaps.

You’re all caught up