Distillation stops needing a stronger teacher: task-trained policy differences transfer across models, scale gaps barely do
Whether one policy difference transfers depends on the target: Qwen3 targets gain positively while Qwen2.5 targets under a Qwen3 reference gain almost nothing, and swapping in a Qwen2.5-3B reference turns those gains positive.