Mingju Chen

The work identifies Decision–Timestamp Mismatch in on-policy self-distillation for long-horizon agents—privileged guidance may correspond to a decision at a different timestep, and a student decision may span multiple timesteps—and introduces AlignOPSD, which first rectifies privileged supervision using functional correspondences across sibling rollouts and then applies semi-Markov hierarchical credit assignment over variable-duration decision spans; with Qwen2.5-3B/7B it outperforms GRPO on all eight backbone–aggregate-metric comparisons across ALFWorld, WebShop, and Search-QA by 5.5–8.7%, ranking first in six.

The work identifies Decision–Timestamp Mismatch in on-policy self-distillation for long-horizon agents—privileged guidance may correspond to a decision at a different timestep, and a student decision may span multiple timesteps—and introduces AlignOPSD, which first rectifies privileged supervision using functional correspondences across sibling rollouts and then applies semi-Markov hierarchical credit assignment over variable-duration decision spans; with Qwen2.5-3B/7B it outperforms GRPO on all eight backbone–aggregate-metric comparisons across ALFWorld, WebShop, and Search-QA by 5.5–8.7%, ranking first in six.