---
type: "post"
id: "we-recently-launched-benchmark-reviews-an-initiative-led-073033"
slug: "we-recently-launched-benchmark-reviews-an-initiative-led-073033"
title: "We recently launched Benchmark Reviews , an initiative led by senior researcher Michelle Campeau, where we audit external AI benchmarks and assess whether their scores accurately measure what they..."
description: "Epoch AI has launched Benchmark Reviews, an initiative for independent reviews of external AI benchmarks."
retrieval_nugget: "Epoch AI has launched Benchmark Reviews, an initiative for independent reviews of external AI benchmarks."
published_at: "2026-10-24"
updated_at: "2026-10-24"
record_date: "2026-10-24"
date_kind: "published_at"
topics: ["evals","verification"]
entities: ["Epoch AI","Benchmark Reviews"]
related_patterns: ["ai-engineering-evaluations-are-splitting-into-task-specific"]
novelty_label: "new_fact"
what_changed: "Epoch has launched its own independent reviews of external AI benchmarks, using verdicts to indicate whether scores are interpretable, flawed, or insufficiently documented."
prior_refs: ["memory:0400603e-a93a-8583-a8ee-e0344084867d"]
source_url: "https://epoch.ai/data/benchmark-reviews-documentation"
source_urls: ["https://epoch.ai/data/benchmark-reviews-documentation"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:we-recently-launched-benchmark-reviews-an-initiative-led-073033"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/we-recently-launched-benchmark-reviews-an-initiative-led-073033/","markdown":"https://newruntime.com/posts/we-recently-launched-benchmark-reviews-an-initiative-led-073033.md","json":"https://newruntime.com/posts/we-recently-launched-benchmark-reviews-an-initiative-led-073033.json"}
---

# We recently launched Benchmark Reviews , an initiative led by senior researcher Michelle Campeau, where we audit external AI benchmarks and assess whether their scores accurately measure what they...

## Retrieval answer

Epoch AI has launched Benchmark Reviews, an initiative for independent reviews of external AI benchmarks.

Epoch AI has launched Benchmark Reviews, an initiative for independent reviews of external AI benchmarks. Its documentation says the reviews assess whether benchmark scores measure what they are described as measuring.

The program assigns one of four verdicts. “Verified” means a benchmark can broadly be interpreted as described and any errors do not substantially affect results. “Flawed” denotes one or more substantive issues relevant to interpretation. “Not enough info” means Epoch lacks sufficient material to review it. Benchmarks created by Epoch will receive a “By Epoch” label and will not be reviewed because of a conflict of interest.

Epoch invites suggestions for benchmarks at reviews@epoch.ai. The published documentation does not establish which specific benchmarks have been reviewed, how many have received each verdict, or the results of any individual audit.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Evals](https://newruntime.com/topics/evals.md): Explore the evals topic hub.
- topic hub: [Verification](https://newruntime.com/topics/verification.md): Explore the verification topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)