Back to AIBriefs
AnalysisAI Models

Metric-Dependent Annotation Saturation for Learning from Label Distributions

Metric-Dependent Annotation Saturation for Learning from Label DistributionsApple ML Research

Apple ML Research fine-tunes NLI models on label distributions from ChaosNLI, finding that the number of annotators needed depends on the evaluation metric. The study shows that annotation saturation is metric-dependent.

17 hours ago
Metric-Dependent Annotation Saturation for Learning from Label Distributions — AIBriefs