AnalysisAI ModelsSeptember 14, 2026

Amazon Science paper tackles correlated LLM judge votes

Amazon Science's ICML paper "Dependence-aware label aggregation for LLM-as-a-judge via Ising models" models correlations between judge outputs instead of assuming independent errors. It beat the best baseline — judges weighted by historical accuracy — by 9% to 14% across three tasks.

1 source

More stories today

Open the live feed