SVEET trains only on a bidirectional video diffusion model and transfers editing zero-shot to a streaming backbone at 15 FPS on a single H100
The work proposes SVEET, a framework that trains a control branch only on a pretrained bidirectional video diffusion model and, through a temporally independent 2D spatial-attention control branch plus Orthogonal Decoupled Training (ODT) that bridges the bidirectional-to-autoregressive feature gap, enables high-quality streaming video editing without retraining or distilling the streaming backbone, reaching 15 FPS on a single H100 GPU and outperforming several baselines on style transfer, video inpainting, and depth-to-video generation.