Skip to main content
Search

# Group Sequence Policy Optimization

1 related articles

Subscribe to updates
  1. vLLM Blog

    VeRL-Omni v0.3.0 brings async execution to multimodal RL training: short answers still favor sync, long ones favor separate-async

    VeRL-Omni v0.3.0 extends asynchronous execution to multimodal reinforcement-learning training across text, audio input and diffusion models, and makes the V1 trainer built on TransferQueue and ReplayBuffer the default. Previously a strictly alternating loop left generation and training idle in turn. In MiniCPM-o 4.5 audio-visual question answering, separate-async ran about 9% slower per prompt on natural short answers but about 6.7% faster per prompt at forced 1024-token responses, so the execution mode should follow the workload.

You’re all caught up