Anthropic introduces Conceptual Reasoning Index benchmark suite

The CRI aggregates three conceptual reasoning benchmarks, published at conceptualreasoning.ai with the primary dataset, LMCA, available via request form. Per Anthropic, the benchmarks measure models' ability to reason about questions with limited empirical evidence, a capability relevant to automating AI risk-reduction work.