AppleAnalysisAI ModelsOctober 12, 2026

Apple study finds LLM translation quality annotation unreliable

Read original source →machinelearning.apple.com

Apple researchers tested LLMs against human annotators on MQM and Error Span Annotation across 70 language pairs plus WMT23 and WMT25 data. LLM agreement beat human-human agreement on some tasks but varied widely by scheme, language pair, and domain, staying unreliable in most settings.

1 source

More stories today

Open the live feed