Field noteSep 25, 20262 min read1 source

Why AI Assistants Are Slow—and How to Make Them Faster

In one minute

The bottleneck in consumer agent latency is often orchestration and repeated interface discovery, not model generation speed alone.

Cerebras recorded several assistants attempting the same dinner-reservation request: Meta Muse took 4 minutes 36 seconds, Claude Cowork took 6 minutes 25 seconds and made 57 tool calls, and Grok Bot took 7 minutes 40 seconds. In its own test configuration, Cerebras used Qwen 3.8 27B with the Pi agent harness and reported a 22-second median from two successful runs. It also says the optimized test reduced tool calls by more than 80 percent.

Parallelizing independent availability checks, preserving a reusable site-navigation procedure, and reducing inference pauses remove different components of agent latency. The company’s browser/API comparison—6.8 seconds in its optimized run versus 4 minutes 31 seconds in an earlier Grok trace—illustrates the gain from changing the whole execution path rather than waiting on checks sequentially.

This matters now because personal assistants are shifting from demonstrations toward delegated transactions, where a several-minute wait can erase the convenience of automation. Teams building agents should treat tool-call topology, procedural memory, and inference latency as one performance budget. The first operational implication is that repeatable web workflows should be encoded as reusable procedures while live facts such as availability and prices remain fresh.

The evidence boundary is that this is a vendor’s internal, narrowly scoped set of recorded runs, and the reported comparison combines changes to the model, harness, and execution path; it does not identify the causal contribution of any single optimization. The first watch condition is whether independent third-party tests reproduce similar end-to-end gains across multiple websites, models, and agent harnesses.

Evidence / sources

  1. 1cerebras.ai/blog/the-rise-of-slow-personal-assistants
All Field Notes

Next reads

Read next

Open the graph
  1. 01archiveField NotesOpen the latest editorial analysis.
  2. 02source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract