Skip to main content
Search

# Full-Duplex Interaction

2 related articles

Subscribe to updates
  1. arXiv

    Duo v1 turns the world model into a two-way conversation: 17-frame chunks, it watches while it speaks, and it can be interrupted

    Duo v1 is a full-duplex world model that generates the assistant's audio and video in real time while continuously taking in the user's audiovisual input. Earlier world models largely kept intelligence outside the world, letting users steer scenes through keyboard, mouse or text prompts while nothing inside perceived the user or decided how to respond. Duo v1 cuts interaction into 17-frame chunks, about 0.71 s at 24 fps; a language intent module decides per chunk whether to speak or wait, and a causal audiovisual module generates the matching sound and picture. Of 180 checks across 30 real-time duplex cases and six binary criteria, 168 passed, including all 90 on language, speech intelligibility and visual identity, while content responsiveness reached 73.3%.

  2. arXiv

    Realtime-Venus splits real-time dialogue from background work into a dual-loop runtime with two 9B frontends, leading online models on six of eight video benchmarks

    The work presents Realtime-Venus, a proactive full-duplex interaction system with two separately trained 9B models, Realtime-Venus-Omni for audio-visual interaction and Realtime-Venus-Audio for spoken interaction, which align continuous perception, conversational control, native speech generation, and private delegation requests on a shared causal timeline while Realtime-Venus-Harness executes background capabilities asynchronously in a dual-loop runtime, achieving the highest scores among compared online models on six of eight video benchmarks and leading or matching on several audio understanding, spoken question answering, and full-duplex overlap metrics.

You’re all caught up