Skip to main content
Search

# Temporal Reasoning in VideoLLMs

1 related articles

Subscribe to updates
  1. arXiv

    Reversing frame order often leaves VideoLLM answers unchanged; researchers locate a mid-layer temporal peak and inject it back into later layers without training

    The work defines the temporal divergence vector τ_l, the layer-wise representational difference induced by reversing frame order, and finds across Qwen2.5-VL-7B, Qwen3-VL-8B, and InternVL2.5-8B that its normalized magnitude peaks at intermediate-to-late layers and then declines toward the output; question-conditioned analysis and attention knockout confirm the peak is specific to temporal reasoning and functionally critical, motivating Temporal Activation Injection (TAI), a training-free method that extracts τ_l at the peak and reinjects it into subsequent layers following the measured decay, consistently improving temporal reasoning across three VideoLLMs and four benchmarks with negligible impact on non-temporal tasks.

You’re all caught up