Field noteOct 29, 20265 min read1 source

Concordat: open-source Python library enforces typed session protocols on LLM agents

In one minute

Concordat is an open-source Python library that makes an LLM agent follow a finite-state session protocol at runtime rather than relying on prompt instructions. Its evaluation suggests that restricting available actions can prevent skipped human confirmations without a significant loss in task success.

What changed: Concordat introduces a distinct open-source library for enforcing typed session protocols on LLM agents; none of the prior documents cover this release.

What happened

Milad Sikaroudi introduced Concordat in an arXiv paper submitted on October 27, 2026. The project is an open-source Python library for agents that can take consequential actions, such as cancelling bookings, issuing refunds, or changing accounts. Its central claim is that rules for those actions should not exist only as prose in a system prompt, because a model follows prompt rules only to the extent that it chooses to do so on a given turn.

Concordat instead treats an agent as an object with an interface defined by a finite-state protocol. The approach draws on typestate and session types: an agent has a current state, and its permitted operations depend on that state. On each turn, the model is offered only tools that are legal in its current protocol state. A tool call outside that set is rejected before it can create side effects. If a decision is reserved for a human, the agent can request that decision but cannot make it itself.

The library also includes controls for resource use across agent handoffs. Token and tool-call budgets are charged and split linearly across those handoffs. Protocols are checked when they are defined. Concordat further rejects an agent subclass if it could bypass a parent agent's protocol, which the paper describes as a behavioural form of Liskov substitution. The design is therefore aimed at making authority and allowed transitions properties of the running system rather than instructions the model may ignore.

The paper evaluates a Concordat agent against the standard tau-bench agent on 50 airline tasks. The evaluation adds simulated customers who pressure the agent to make a change without first obtaining the required explicit confirmation. With GPT-4.1, the standard agent made changes without the required “yes” in 13 of 50 tasks. With Claude Haiku 5.5, it did so in 29 of 128 task-runs. The Concordat agent made no such changes in the reported tests, with no significant difference in task success. The paper also says tau-bench's own reward did not detect most of those policy violations.

What the archive adds

This is a new fact on a related thread rather than a continuation of an earlier Concordat report. Google's session-aware load-balancing note described long-lived agent work as an operational commitment. Concordat addresses a different layer: what an agent may do as a session moves through its allowed states.

Trend signal

This directly supports the pattern that agent security moves to runtime boundaries. Concordat does not ask a model to remember a confirmation policy; it removes illegal tools from the available interface and rejects prohibited calls before side effects. That is a concrete example of shifting a safety boundary from prompt compliance to execution-time constraint.

Why it matters

Teams building agents for account changes, refunds, bookings, or other consequential workflows often encode approval requirements as natural-language rules. That can be adequate for guidance, but it is a weak enforcement mechanism when users pressure an agent, tools are composed across handoffs, or a model takes an unexpected shortcut. Concordat proposes a narrower, more testable boundary: define the states, enumerate legal actions per state, and let the runtime reject anything else.

The reported result matters because task completion alone was not enough to expose the unsafe behavior. An agent could receive a successful benchmark reward while changing something without the required confirmation. Builders should therefore distinguish outcome metrics from protocol-compliance metrics when evaluating an agent that can cause external effects.

What happens next

  • More agent evaluations will separate task success from protocol compliance. (6 months, 65%). Watch for: benchmarks that score confirmations, authorization, and illegal action attempts explicitly.
  • Runtime policy layers will be tested on workflows beyond airline service. (12 months, 55%). Watch for: published evaluations in refund, account-administration, or approval workflows.

Limits and uncertainty

The evidence is a paper and its reported evaluation, not an independent production deployment study. The experiment covers tau-bench airline tasks, simulated customers, and the stated GPT-4.1 and Claude Haiku 5.5 runs; it does not establish performance across other domains, models, tool ecosystems, or adversarial conditions. “No significant difference” in task success is reported without further statistical detail in the supplied material. The source also says Concordat is open source, but the supplied record does not provide implementation details, licensing terms, packaging instructions, or evidence of adoption.

Skill to build now

Take one agent workflow that can change an external system and write its states before refining its prompt. For example: request received, evidence collected, confirmation requested, confirmation received, action executed. For each state, list the only tools that should be callable and the transitions that should be rejected. Then add tests in which a user pressures the agent to skip a required approval. This turns a policy sentence into an interface that can be checked.

Reader takeaway

For consequential agents, the important question is not only whether the model was told to ask permission. It is whether the runtime makes an unconfirmed action impossible to execute. Concordat's results suggest that bounded tool availability and state transitions can catch violations that ordinary task-success scoring misses.

Open question

Can typed session protocols remain practical when a production agent must coordinate many tools, exceptions, and human approval paths without becoming too rigid to complete useful work?

Evidence / sources

  1. 1arxiv.org/abs/2610.37461
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicClaudeExplore the claude topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract