Offline demos and fresh rollouts now share one regression target: unified training lifts math-reasoning avg@32 by 2.33 points
Offline demonstrations, current-policy rollouts, and historical rollouts can now be trained under one regression target, and on four math-reasoning benchmarks the unified configuration improves Qwen3-1.7B benchmark-averaged avg@32 and pass@32 over two-stage SFT plus DAPO by 2.33 and 4.44 percentage points.