---
type: "post"
id: "continual-learning-exam-benchmark-finds-best-llm-agent-44b039"
slug: "continual-learning-exam-benchmark-finds-best-llm-agent-44b039"
title: "Continual Learning Exam benchmark finds best LLM agent completes only 47.7% of 600 progressive professional task levels"
description: "Researchers have released Continual Learning Exam (CLE), a benchmark for testing whether LLM agents improve through accumulated experience across professional workflows."
retrieval_nugget: "Researchers have released Continual Learning Exam (CLE), a benchmark for testing whether LLM agents improve through accumulated experience across professional workflows."
published_at: "2026-10-27"
updated_at: "2026-10-27"
record_date: "2026-10-27"
date_kind: "published_at"
topics: ["evals","agents"]
entities: ["Continual Learning Exam"]
related_patterns: ["ai-engineering-evaluations-are-splitting-into-task-specific"]
novelty_label: "new_fact"
what_changed: "Introduces the Continual Learning Exam benchmark, reporting that the best agent completes 47.7% of its 600 levels; the prior covers a different five-level cumulative-learning benchmark."
prior_refs: ["memory:e96bf320-0e94-8b6a-a575-694c371552a1"]
source_url: "https://arxiv.org/abs/2610.33956"
source_urls: ["https://arxiv.org/abs/2610.33956"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:continual-learning-exam-benchmark-finds-best-llm-agent-44b039"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/continual-learning-exam-benchmark-finds-best-llm-agent-44b039/","markdown":"https://newruntime.com/posts/continual-learning-exam-benchmark-finds-best-llm-agent-44b039.md","json":"https://newruntime.com/posts/continual-learning-exam-benchmark-finds-best-llm-agent-44b039.json"}
---

# Continual Learning Exam benchmark finds best LLM agent completes only 47.7% of 600 progressive professional task levels

## Retrieval answer

Researchers have released Continual Learning Exam (CLE), a benchmark for testing whether LLM agents improve through accumulated experience across professional workflows.

Researchers have released Continual Learning Exam (CLE), a benchmark for testing whether LLM agents improve through accumulated experience across professional workflows. The paper was submitted to arXiv on October 25, 2026.

CLE contains 120 human-authored tasks arranged as five-level ladders, for 600 levels in total. It covers 89 professional roles across 12 occupational domains. An agent must pass a level to unlock the next one, and later assignments build on earlier work. More than 50 domain experts contributed to the benchmark. Submissions are assessed by an evaluation agent against human-authored rubrics.

The authors tested 17 harness-model configurations using frontier LLMs. Providing diagnostic feedback after failure and allowing one revision produced a median completion gain of 5.3 percentage points. The best system completed 47.7% of levels and completed all five levels in 23.3% of tasks.

The paper does not establish that these results represent performance in every workplace, nor that feedback produces durable learning outside CLE. It is an arXiv preprint, and its scores depend on this benchmark's tasks, rubrics, and evaluation-agent setup.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Evals](https://newruntime.com/topics/evals.md): Explore the evals topic hub.
- topic hub: [Agents](https://newruntime.com/topics/agents.md): Explore the agents topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)