Task-Progress Distillation Lets a 1.7B Agent Reach 72.4% Unseen Success on ALFWorld from 404 Demonstrations
The work introduces Task-Progress Distillation (TPD), an offline approach that pairs each demonstrated action with a short task-stage label so the student selects actions by jointly scoring admissible stage–action pairs; on ALFWorld, a 1.7B student trained with 404 demonstrations reaches 72.4% mean unseen task success with either TPD or action-only supervision, versus 48.3% for a reasoning-trained student using constrained action selection, and explicit stages raise success from 48.0% to 67.7% at 200 demonstrations, with action-only catching up to 76.9% at 808.