Measuring benchmark optimization in speech recognition

A new Hugging Face analysis measures how much ASR models are optimized to public benchmarks, warning that such tuning may fail to generalize beyond test sets. The accompanying paper (arXiv:2608.19936) proposes quantitative methods for detecting this benchmark optimization.