Field noteOct 27, 20261 min read1 source

Continual Learning Exam benchmark finds best LLM agent completes only 47.7% of 600 progressive professional task levels

In one minute

Researchers have released Continual Learning Exam (CLE), a benchmark for testing whether LLM agents improve through accumulated experience across professional workflows.

What changed: Introduces the Continual Learning Exam benchmark, reporting that the best agent completes 47.7% of its 600 levels; the prior covers a different five-level cumulative-learning benchmark.

The paper was submitted to arXiv on October 25, 2026.

CLE contains 120 human-authored tasks arranged as five-level ladders, for 600 levels in total. It covers 89 professional roles across 12 occupational domains. An agent must pass a level to unlock the next one, and later assignments build on earlier work. More than 50 domain experts contributed to the benchmark. Submissions are assessed by an evaluation agent against human-authored rubrics.

The authors tested 17 harness-model configurations using frontier LLMs. Providing diagnostic feedback after failure and allowing one revision produced a median completion gain of 5.3 percentage points. The best system completed 47.7% of levels and completed all five levels in 23.3% of tasks.

The paper does not establish that these results represent performance in every workplace, nor that feedback produces durable learning outside CLE. It is an arXiv preprint, and its scores depend on this benchmark's tasks, rubrics, and evaluation-agent setup.

Evidence / sources

  1. 1arxiv.org/abs/2610.33956
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicEvalsExplore the evals topic hub.
  2. 02topicAgentsExplore the agents topic hub.
  3. 03archiveField NotesOpen the latest editorial analysis.
  4. 04source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract