Five new papers expose flaws in AI benchmark and safety scoring

An audit of safety benchmarks R-Judge, InjecAgent, AgentHarm and AgentDojo finds their scores quoted interchangeably despite measuring different behaviors. Another paper finds contamination checks uninformative: four flagship models fail them on unmemorizable questions. A third coins "evaluation blindness," silent measurement failures from training to deployment.