Field noteOct 23, 20261 min read1 source

Simular's Agent S4 evolves agent interfaces so Qwen3.8-27B tops open-source results on OSWorld V2

In one minute

Simular has published Agent S4, an “agent scientist” that changes the interfaces available to a computer-use agent rather than changing the task model or its harness.

What changed: Simular’s Agent S4 research adds a benchmark result: Qwen3.8-27B tops open-source results on OSWorld V2.

A meta-agent reviews task trajectories and evolves a repository of interfaces and usage knowledge through population-based mutation and crossover.

In Simular’s OSWorld V2 evaluation, Qwen3.8-27B with the evolved repository reached 21.3% binary success across 108 tasks. The company reports 5.56% for the same model with fixed Qwen CUA interfaces, and a reported cost of $1.10 per task. Its comparison table lists GPT-5.5 at 13.0% and $25.50 per task, and Claude Opus 4.8 at 20.6% and $72.40 per task.

The repository can add application-specific or cross-application helpers, such as bulk spreadsheet edits and requests from a logged-in browser tab. Simular also reports ScienceBoard success rising from 41.4% to 58.6% with the approach. The source does not establish independent replication, performance outside these benchmarks, or that the reported cost comparisons hold in production deployments.

Evidence / sources

  1. 1simular.ai/articles/agent-s4-evolving-the-interfaces-computer-use-agents-work-throughagen
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicAgent InterfacesExplore the agent-interfaces topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract