On-policy distillation study finds teacher guidance can mislead

A new arXiv paper shows on-policy distillation (OPD) can be misled by teacher guidance, proposing reward-aligned methods. Another study finds OPD mainly suppresses low-probability tokens, not teacher guidance, and introduces a supervision-free entropy-adaptive method that improves reasoning.