The observed record is deliberately narrow. Simon Willison’s annotated keynote says that Claude Opus 4.5 and GPT-5.1 were released in November 2025. He further says that, when paired with Claude Code and Codex respectively, the agents moved from often making mistakes to being reliable enough for day-to-day use. That is an experienced practitioner’s assessment, not an independently measured industry benchmark.
New branch reason: No prior New Runtime record was supplied; this begins a distinct record because it links a claimed coding-agent capability threshold to the separate operational problem of containment.
Thesis
Coding agents appear to have crossed a practical usability threshold, shifting the limiting problem from code generation alone toward controlled deployment.
Observed facts
Simon Willison’s annotated keynote says Claude Opus 4.5 and GPT-5.1 were released in November 2025.
1Willison says that, paired with Claude Code and Codex respectively, these agents progressed from often making mistakes to being reliable enough for day-to-day use.
1Willison notes that around 40 of 277 sessions at the referenced conference touched sandboxing or agent security.
1
Mechanism
Better base models can change agent usefulness discontinuously when they are combined with a harness that supplies tools, iteration, and a working environment.
Why now
Willison’s September 2026 retrospective frames this threshold as the practical backdrop to developers taking on more projects and to the growing attention on sandboxing and agent security.
Implications
Teams should treat capable coding agents as delegated actors that require bounded permissions, isolated execution, and review paths, rather than as autocomplete with a larger context window.
Containment and authority design are becoming central operational concerns as agent task scope expands.
Evidence boundary
This is one speaker’s curated retrospective and personal evaluation; it does not establish universal reliability across repositories, tasks, models, or organizations.
Watch conditions
Look for independently reproducible evidence that agent reliability persists on long-running, permissioned tasks—and for real incidents or stronger sandboxing practices that reveal the cost of granting agents broader authority.
Watch whether organizations standardize sandboxing, tool permissions, and audit trails as agents receive access to production-adjacent systems.