Embarrassingly Simple Self-Distillation Improves Code Generation

Apple researchers find LLMs can improve code generation using only their own raw outputs via simple self-distillation (SSD). The method samples solutions at a controlled temperature and truncation, without a verifier, teacher model, or reinforcement learning.