---
type: "post"
id: "critpt-v2-launches-with-70-revised-research-level-d7f03a"
slug: "critpt-v2-launches-with-70-revised-research-level-d7f03a"
title: "CritPt v2 launches with 70 revised research-level physics challenges and agentic code execution."
description: "Artificial Analysis has published its CritPt v2 evaluation page, covering a revised benchmark for research-level physics reasoning."
retrieval_nugget: "Artificial Analysis has published its CritPt v2 evaluation page, covering a revised benchmark for research-level physics reasoning."
published_at: "2026-10-23"
updated_at: "2026-10-23"
record_date: "2026-10-23"
date_kind: "published_at"
topics: ["claude"]
entities: ["CritPt v2","Artificial Analysis","CritPt","GPT-6 Astra","GPT-6.1 Sol","Claude Opus 5.5"]
related_patterns: ["ai-engineering-evaluations-are-splitting-into-task-specific"]
novelty_label: "new_fact"
what_changed: "CritPt v2 adds a separate benchmark of 70 revised research-level physics challenges, solved with code execution; prior coverage concerned TheoPhysEval’s 50-problem benchmark and results."
prior_refs: ["memory:74714842-13c9-8337-acae-44313169f685","memory:fb342a83-671e-89ab-a581-7c6d61ebb6b7","memory:8b82558f-adc2-8687-ab94-9f7777250f7d"]
source_url: "https://artificialanalysis.ai/evaluations/critpt-v2"
source_urls: ["https://artificialanalysis.ai/evaluations/critpt-v2"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:critpt-v2-launches-with-70-revised-research-level-d7f03a"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/critpt-v2-launches-with-70-revised-research-level-d7f03a/","markdown":"https://newruntime.com/posts/critpt-v2-launches-with-70-revised-research-level-d7f03a.md","json":"https://newruntime.com/posts/critpt-v2-launches-with-70-revised-research-level-d7f03a.json"}
---

# CritPt v2 launches with 70 revised research-level physics challenges and agentic code execution.

## Retrieval answer

Artificial Analysis has published its CritPt v2 evaluation page, covering a revised benchmark for research-level physics reasoning.

Artificial Analysis has published its CritPt v2 evaluation page, covering a revised benchmark for research-level physics reasoning. CritPt v2 contains 70 composite challenges, which models attempt using a code-execution tool in an offline Linux sandbox.

The underlying benchmark was written by more than 60 active physics researchers. According to Artificial Analysis, the benchmark authors and physics collaborators reviewed the v2 tasks to correct underspecified statements, errors, and typos. Artificial Analysis says it evaluates models independently and currently lists 11 models; its page reports GPT-6 Astra (Max) at 83.1%, GPT-6.1 Sol (Max) at 82.0%, and Claude Opus 5.5 (Max, Default Fallback) at 77.7%.

Artificial Analysis says it will provide a free grading API with the benchmark authors, available case by case to approved labs and researchers. The source does not establish that scores transfer to real scientific research, nor does it provide public API access for general users. Source: https://artificialanalysis.ai/evaluations/critpt-v2

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Claude](https://newruntime.com/topics/claude.md): Explore the claude topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)