Hugging Face Journal Club discusses Direct On-Policy Distillation

The Hugging Face research team discusses the paper "Weak-to-Strong Generalization via Direct On-Policy Distillation," which proposes a cheap way to transfer reinforcement learning benefits from small models to larger ones by measuring how the small model's policy changes rather than imitating it directly.