AnalysisAI ModelsAugust 28, 2026

Scaling distillation data makes latent teacher traits more recoverable

Read original source →arxiv.org

New arXiv paper shows larger model-generated datasets can make subtle teacher-specific signals easier to recover, alongside improving distillation. A companion paper offers a causal account of how such subliminal traits persist via optimizer state.

2 sources

More stories today

Open the live feed