AnalysisAI ModelsSeptember 13, 2026

Paper proposes drift-constrained fine-tuning for instruct models

The method sets a behavioral drift budget before optimization, arguing only the direction of the update matters when fine-tuning instruct models. It targets the tradeoff where fine-tuning improves target performance but degrades existing capabilities.

1 source

More stories today

Open the live feed