High benchmark scores don't guarantee health AI readiness, study finds

Nature Medicine reports that LLMs achieving high scores on health benchmarks fail adversarial stress tests, exposing shortcut reliance and fragile visual grounding. The findings suggest current evaluations overstate application readiness for clinical settings.