Evidence-linked trend hypothesis

Verification bandwidth is the scarce engineering resource

As coding agents accelerate implementation, specifications, review judgment, evaluation coverage, and release accountability become the binding constraints.

Current thesis

  • The primary bottleneck in agentic software delivery is moving from code production to the human and machine capacity required to verify it.
  • Confidence: high.
  • Supported by 5 normalized raw signals.

Source ledger

Publishable sources attached to this record.

5 public sources
#SourceRolePublic status
1addyo.substack.comsourceprimary receiptsource_urls
2databricks.comsourcesupporting receiptsource_urls
3hamel.devsourcesupporting receiptsource_urls
4addyosmani.comsourcesupporting receiptsource_urls
5anthropic.comsourcesupporting receiptsource_urls

What is changing

Coding agents compress investigation, implementation, testing, and repair into fast inner loops. That does not compress the entire software lifecycle at the same rate. Requirements still need to be correct. Architecture still carries long-lived tradeoffs. A passing test suite still represents only the behavior someone chose to test.

The result is a queue migration. More candidate changes reach the boundary where someone or something must decide whether the work is correct, necessary, secure, maintainable, and ready to release.

Supporting evidence

  • Databricks evaluates coding agents on fresh tasks from its own large codebase, because public benchmarks miss repository-specific integration failures.
  • The new SDLC analysis separates output evals from trajectory evals and shows that faster implementation does not remove requirements, review, or maintenance.
  • Eval-smell diagnostics treat missing traces and unverifiable outputs as product failures, not only model failures.
  • Research on AI assistance and coding skills adds a second-order risk: the people expected to supervise generated code may lose opportunities to build the debugging knowledge required for that supervision.

Operational consequence

The durable investment is an outer loop: acceptance criteria before execution, repository-specific evals, evidence-producing runs, review queues sized by risk, and release controls that preserve accountable human judgment where it changes the outcome.