Field noteOct 24, 20261 min read1 source

AWS and UC Berkeley open-source Infinity, a Rust agent runtime that suspends agents at tool calls and fits ~75,000 agents in 8 GB

In one minute

AWS and UC Berkeley have released Infinity, an Apache 2.0-licensed agent runtime in the Hydro project.

What changed: AWS and UC Berkeley introduce Infinity, a Rust runtime that suspends agents during tool calls and claims to fit about 75,000 agents in 8 GB.

AWS describes it as an early research release.

Infinity treats an agent as a sequence of bounded execution slices. In each slice, it loads conversation history from a pluggable store, runs one model completion, persists the output, and dispatches at most one tool call. Rather than wait on that call, the runtime suspends the agent; a later tool result or external event resumes it from stored state.

AWS says this design can run on serverless infrastructure because no function needs to remain active while an agent waits. Its reported synthetic benchmark put idle-agent memory use at about 100 KB and fit roughly 75,000 concurrent agents into the 8 GB memory of a Raspberry Pi 5. The post also describes a Lambda-oriented mode using SQS FIFO, Aurora DSQL, and DynamoDB.

The source does not establish equivalent performance with production models, real tool traffic, or customer workloads. It also does not present Infinity as a generally available managed AWS service.

Evidence / sources

  1. 1aws.amazon.com/blogs/opensource/introducing-infinity-a-runtime-for-extreme-agent-concurrency
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicAgent RuntimeExplore the agent-runtime topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract