Skip to main content
Search

# Long-Video Generation

4 related articles

Subscribe to updates
  1. arXiv

    History Forcing teaches few-step video models to remember: a 1.3B student reaches 79.82 on 60-second VBench-Long

    Few-step autoregressive video diffusion models gradually lose subject and scene information over long rollouts, and existing distillation targets do not constrain distant history separately. History Forcing builds a context residual from the difference between one autoregressive teacher's predictions with and without extra history, then weights it into the DMD or OPSD distillation target. A 1.3B student reaches a VBench quality score of 85.07 for 15-second generation and a VBench-Long aggregate of 79.82 for 60-second generation, and raises PlayWorld Evolution Quality from 2.35 to 2.70 when the camera leaves and returns.

  2. arXiv

    SMI uses a multimodal LLM to manage spatial memory, improving memory sparsity, generation stability, and spatial consistency in long-video world models

    The work proposes Spatial Memory Intelligence (SMI), described as the first framework to systematically employ an understanding model (a multimodal large language model) for spatial-memory management in long-video world models, through four coordinated atomic operations: spatial clustering, within-cluster sparsification, action-aware retrieval, and reliability-aware filtering; experiments across multiple baselines, benchmarks, and world-model backbones report comprehensive improvements in memory sparsity, generation stability, and spatial consistency, supporting effectiveness and generalizability.

  3. arXiv

    NVIDIA turns distillation into pluggable LoRAs: train once, then deploy to 54 video models without retraining

    LongLive-Plug introduces a once-for-all distillation framework that distills single-pass classifier-free guidance, four-step sampling, and long-context error correction into reusable LoRAs on a base model, enabling training-free plug-and-play deployment to 54 downstream video models across three backbone families, with results on SCOPE and Wan2.2-Fun-5B-Control that beat naive four-step sampling and approach per-target distillation.

  4. arXiv

    WorldAttention pairs hierarchical KV caching with hybrid sparse attention to reach 22 FPS on a single H100 and 0.9472 subject consistency on VBench-Long

    The work proposes WorldAttention, an attention architecture for interactive video world models that combines a Hierarchical KV Cache (HKV) storing and retrieving page-level KV across GPU, CPU, and NVMe tiers with a Hybrid Sparse Attention (HSA) that fuses a linear global branch and a head-adaptive block-sparse branch, reporting subject consistency of 0.9472 on VBench-Long and 0.9668 on InterVBench, a 14.02x sparse-kernel speedup over FlashAttention-3, a 2.21x end-to-end speedup, and 22.0 FPS on a single NVIDIA H100.

You’re all caught up