AnalysisAI ModelsSeptember 4, 2026

On-policy distillation papers probe teacher guidance flaws

Read original source →arxiv.org

A wave of arXiv papers examines on-policy distillation (OPD), where teacher supervision is applied to student-generated trajectories. One finds OPD improves over hundreds of steps from a single query, suggesting it is algorithm-starved rather than data-starved; another argues OPD mainly suppresses low-probability tokens rather than transferring teacher guidance.

How this story unfolded

3 weeks · 14 reports · from Aug 31

  1. Aug 31
  2. Sep 1
  3. Sep 3
  4. Sep 4
  5. Sep 8
  6. Sep 9
  7. Sep 16
  8. Sep 18
  9. Sep 21
  10. Sep 22

More stories today

Open the live feed