OmniSeek lets a 30B omni-modal model decide whether to look or listen: leading same-scale open models across 10 audio-visual benchmarks, 74.6% on VideoHolmes
The authors present OmniSeek, which turns an Omni-LLM into an active multi-turn tool-using agent (get_audio_clip, get_video_clip), backed by a data engine that synthesizes OmniTraj-170K with 169,725 interleaved audio-visual chain-of-thought trajectories, plus a three-phase training pipeline and an Audio-Visual Necessity reward, achieving leading or competitive results on 10 omni-modal and 4 general video benchmarks.