# vLLM-Omni

The vLLM-Omni team presents an orchestrator-centered multi-stage serving runtime that splits omni, TTS, diffusion, world-model and VLA workloads into stages bound to individual engines and resource budgets, moves hidden states, codec codes, latents and paged KV through OmniConnector, and adds session control for long-lived interaction; it reports H100/H200 measurements for Qwen3-Omni speech serving, a TTS portfolio, image and video diffusion, and MiniCPM-o duplex health metrics.

The vLLM-Omni team presents an orchestrator-centered multi-stage serving runtime that splits omni, TTS, diffusion, world-model and VLA workloads into stages bound to individual engines and resource budgets, moves hidden states, codec codes, latents and paged KV through OmniConnector, and adds session control for long-lived interaction; it reports H100/H200 measurements for Qwen3-Omni speech serving, a TTS portfolio, image and video diffusion, and MiniCPM-o duplex health metrics.