Field noteOct 24, 20261 min read1 source

Four new benchmark reviews. We graded one as Verified, and three as Flawed.

In one minute

Epoch AI announced new reviews in its AI benchmark registry.

What changed: Epoch’s benchmark registry now reports four new benchmark reviews: one verified and three flawed.

The announcement says that one review received a Verified verdict and three received Flawed verdicts. It also says that four others did not have enough information for a verdict.

The public registry describes itself as covering 94 AI benchmarks across mathematics, software engineering, agentic workflows, games, and other domains. Its current review filters show 5 Verified benchmarks, 12 Flawed benchmarks, and 5 marked Not enough info.

The supplied public material does not name the benchmarks covered by the new reviews, give dates for the individual decisions, or provide the evidence and methodology behind each verdict. It therefore establishes an update to Epoch AI's review registry, not a conclusion about any particular model or benchmark score.

Evidence / sources

  1. 1epoch.ai/benchmarks/search?reviewed=verified&reviewed=flawed&reviewed=not-enough-info
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicEvalsExplore the evals topic hub.
  2. 02topicVerificationExplore the verification topic hub.
  3. 03archiveField NotesOpen the latest editorial analysis.
  4. 04source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract