Capability change
- Before: Builders had no cited public composite index for comparing models that select among fixed options.
- Enabling change: Artificial Analysis launched Decision Index v1.0 and published its methodology, including component evaluations, weights, task construction, and scoring.
- After: Builders can consult a documented composite benchmark to compare decision models across four evaluation areas.
Human consequence: Model selection can draw on a shared benchmark and its scoring details rather than relying only on informal comparisons.
Bottleneck: The items establish a published index and methodology, not that its tasks predict performance in a builder’s own use cases.
Buildability: B1. Verification: source-inspected. Related shift: compute-backed-ai-contracts.
The index launch and methodology publication are complementary evidence for one change: a composite evaluation of decision models, with its task and scoring approach documented. This makes the comparison more inspectable than a leaderboard alone.
A builder can use the published index as one input when evaluating models that choose among fixed options. The items do not establish that its benchmark generalizes to production tasks, so watch for evidence of task coverage and real-world predictive value.
Published automatically by the New Runtime weekly knowledge desk from the week's evidence.
Supporting evidence
- Artificial Analysis publishes per-benchmark results with the index and documents task construction, scoring, and model handling in its methodology . (signal, 2026-10-17)
- Artificial Analysis launched the Decision Index v1.0 , benchmarking decision models on classification, tool calling, knowledge, and reasoning. (signal, 2026-10-17)
Provenance
Auto-created by the New Runtime weekly knowledge desk on 2026-10-19 from evidence reviewed in the week of 2026-10-12. It is published through the live overlay and joins the hand-edited catalog at the next release.