Latent-Foresight jointly learns a latent tokenizer and a flow-based dynamics model end-to-end, consistently outperforming two-stage baselines across future scene understanding tasks
The work proposes Latent-Foresight, an end-to-end framework that jointly learns a latent tokenizer and a flow-based generative dynamics model, explicitly shaping the representation to support temporal predictability, with key design choices that prevent latent collapse and align reconstruction with generative objectives; experiments report more temporally coherent latent representations and consistent gains over two-stage baselines across multiple future scene understanding tasks and prediction horizons, while eliminating separate training stages, including during high-resolution adaptation.