Study: No universal signal predicts sample-level LLM regression across version updates

A new arXiv paper finds that aggregate gains from LLM version updates don't predict individual sample regressions, and no universal signal reliably identifies them. The study tests multiple signals across frontier models, highlighting the challenge of tracking model behavior across releases.