The work proposes Adaptive Reward Routing, which jointly adapts where reward-driven updates act and how competing rewards are coordinated during forward-process RL (DiffusionNFT) of joint audio-video diffusion models: it uses bidirectional cross-attention responses as a proxy for evolving cross-modal influence to dynamically reweight token-aware losses and scale gradients across cross-modal layers, and after warm-up uses branch-specific reward-gradient interactions as residual corrections to predefined preference weights, training on 19,487 audio-video prompts over the LTX-2 (19B) and LTX-2.3 (22B) backbones and achieving the best result on nine of ten metrics on the 10,140 prompts of JavisBench.
The work proposes Adaptive Reward Routing, which jointly adapts where reward-driven updates act and how competing rewards are coordinated during forward-process RL (DiffusionNFT) of joint audio-video diffusion models: it uses bidirectional cross-attention responses as a proxy for evolving cross-modal influence to dynamically reweight token-aware losses and scale gradients across cross-modal layers, and after warm-up uses branch-specific reward-gradient interactions as residual corrections to predefined preference weights, training on 19,487 audio-video prompts over the LTX-2 (19B) and LTX-2.3 (22B) backbones and achieving the best result on nine of ten metrics on the 10,140 prompts of JavisBench.