---
type: "post"
id: "frontiermemory-frontiermemory-benchmarking-continual-learning-through-memory-ca7ffa"
slug: "frontiermemory-frontiermemory-benchmarking-continual-learning-through-memory-ca7ffa"
title: "frontiermemory: FrontierMemory: benchmarking continual learning through memory"
description: "Letta has released FrontierMemory, an open benchmark for testing whether memory derived from earlier agent trajectories improves a fresh agent's performance on downstream tasks."
retrieval_nugget: "Letta has released FrontierMemory, an open benchmark for testing whether memory derived from earlier agent trajectories improves a fresh agent's performance on downstream tasks."
published_at: "2026-10-24"
updated_at: "2026-10-24"
record_date: "2026-10-24"
date_kind: "published_at"
topics: ["claude"]
entities: ["Letta","FrontierMemory","Harbor","Codex","Claude Code","Hermes","OpenAI Agents SDK"]
related_patterns: ["harness-architecture-outlives-model-choice","company-memory-needs-write-loops","verification-bandwidth-is-the-scarce-resource"]
novelty_label: "same_event"
what_changed: "Same event as Introducing FrontierMemory: a new way to evaluate agent memory through downstream task performance."
prior_refs: ["memory:1ac5cf0a-1cbb-8f6a-a487-fc16400ad8e9","memory:22027708-af3f-81ba-ac16-75268917a035"]
source_url: "https://github.com/letta-ai/frontiermemory"
source_urls: ["https://github.com/letta-ai/frontiermemory"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:frontiermemory-frontiermemory-benchmarking-continual-learning-through-memory-ca7ffa"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/frontiermemory-frontiermemory-benchmarking-continual-learning-through-memory-ca7ffa/","markdown":"https://newruntime.com/posts/frontiermemory-frontiermemory-benchmarking-continual-learning-through-memory-ca7ffa.md","json":"https://newruntime.com/posts/frontiermemory-frontiermemory-benchmarking-continual-learning-through-memory-ca7ffa.json"}
---

# frontiermemory: FrontierMemory: benchmarking continual learning through memory

## Retrieval answer

Letta has released FrontierMemory, an open benchmark for testing whether memory derived from earlier agent trajectories improves a fresh agent's performance on downstream tasks.

Letta has released FrontierMemory, an open benchmark for testing whether memory derived from earlier agent trajectories improves a fresh agent's performance on downstream tasks. The repository describes 15 memory-dependent coding and knowledge-work tasks designed to test learned task contracts, user preferences, and environment rules.

A memory agent reads a fixed corpus of 674 trajectories, each with a PASS or FAIL verifier result, and writes a memory folder. A task agent then attempts the 15 tasks with that folder; the same task agent also runs without memory as a control. The reported score is the strict pass rate on task verifiers. Memory generation is limited to six hours and runs in a sandbox with access limited to the model API host.

The tooling requires Python 3.12+ plus Docker or Modal credentials. The task dataset is listed as `letta-ai/frontier-memory` version v1.0 on Harbor Hub, while the corpus is a gated Hugging Face dataset. The repository includes adapters and submission guidance for custom memory systems, and names Codex, Claude Code, Hermes, Letta Dream, OpenAI Agents SDK, Prime Agent, and Claude Managed Agents among harnesses covered by published comparisons.

The source does not establish that any listed harness will improve production outcomes, nor does it provide an independent validation of leaderboard results or a general measure of continual learning.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Claude](https://newruntime.com/topics/claude.md): Explore the claude topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)