Field noteOct 28, 20266 min read1 source

Arbium releases HelixCove, a generated dataset of workplace computer-use traces with 430 eval questions

In one minute

Arbium has released HelixCove, a generated dataset of workplace computer-use traces from a fictional biotechnology company. Its 430 answerable and unanswerable evaluation questions shift attention from whether an agent can operate an interface once to whether it can reconstruct shared organizational context across people, applications, and time.

What changed: Arbium released HelixCove, a fictional workplace-use trace dataset spanning 1,912 sessions and 59,768 actions, with 430 questions testing retrieval of events and changes over time.

What happened

Arbium announced HelixCove on October 28, 2026 as a dataset intended to represent work unfolding across an organization rather than only the finished artifacts of that work. The first release covers three weeks at a fictional biotechnology company with twelve employees. It contains 1,912 work sessions and 59,768 actions across applications including Word, Outlook, Teams, Excel, SharePoint, and others. Arbium calls the records “Human Traces.”

A trace is intended to connect a person’s visible activity with the surrounding work: the conversation that prompted an action, the document changed by it, and the colleague whose next decision depends on it. Each capture includes a timestamp, application and window, event type, and accessibility-tree text; screen recordings provide visual context. Arbium’s argument is that conventional workplace records tend to preserve outputs, while these traces preserve intermediate decisions, incomplete knowledge, corrections, and coordination that led to those outputs.

The release provides a concrete example of the kind of dependency it wants systems to recover. In the HelixCove scenario, Priya reports a failed reproducibility test in Teams, with 34% variation against a 20% limit. Daniel responds that further runs should not proceed, saves a record named DEV-26-011 in SharePoint QA records, asks Priya to lead the investigation, and Priya accepts. The questions prompted by that sequence are not only about locating a message. They include whether Daniel did what he said and who owns the investigation after the subsequent events.

HelixCove ships 430 questions with known answers. They test simple fact lookup, changes over time, and cases where the dataset does not contain an answer. Arbium says the fictional organization was specified with employees, shared documents, workstreams, and business-changing events. Facts have availability times and audiences, so different employees can learn information at different points. The data was generated using patterns drawn from hundreds of thousands of hours of work captured by Arbium, but all people, documents, and events in HelixCove are fictional. Arbium positions the release alongside work on computer-use observations, task and skill learning, user modeling, goal inference, and workplace-task environments, while focusing this dataset on a shared workplace in which one person’s actions change what others know and do.

What the archive adds

This is a new fact on a related evaluation thread. Human Behavior Bench tested whether models can reproduce distributions of human survey responses. HelixCove instead asks whether a system can recover the changing state of a workplace from traces of activity. Both make a behavior-related claim testable, but their evidence and target tasks differ.

Trend signal

HelixCove supports verification bandwidth is the scarce engineering resource. A computer-use agent can appear capable when judged only by a completed click sequence or final document. The 430 questions make parts of its contextual understanding externally checkable: what happened, who knew it, what changed, and when no answer is justified. That does not solve evaluation, but it supplies a more demanding unit of evidence than a single task outcome.

Connections to other events

An earlier Telegram post described Cohere’s Agentic Task Ecosystem as a large collection of tools for evaluating occupational tasks. HelixCove approaches a related problem from another direction: instead of centering a catalog of tools, it records the connected history around workplace actions. The distinction matters for systems whose task success depends on information and decisions spread between colleagues and applications.

Why it matters

Teams building computer-use agents often need more than action selection. An agent may be able to open a spreadsheet, read a message, or edit a document while still failing to infer whether the information is current, whether another person has taken ownership, or whether a question can be answered from available evidence at all. Those are failures of organizational context, not merely interface control.

HelixCove offers a bounded public artifact for probing that gap. Its value is not a claim that it reproduces every workplace: it is a shared setting where changes, audiences, documents, and actions are connected and where expected answers are available. Builders can use the dataset to distinguish a system that retrieves isolated details from one that tracks a jointly evolving work history. That distinction becomes important as agents move from personal assistance toward workflows involving handoffs, shared records, and consequential follow-up actions.

What happens next

  • Computer-use evaluations will add more tests for temporal state and cross-application handoffs. (6 months, 60%). Watch for: benchmark releases that include answerable and explicitly unanswerable organizational-context questions.
  • Agent teams will report separate scores for interface operation and contextual task recovery. (12 months, 45%). Watch for: evaluations that require evidence of ownership, timing, and information availability rather than a final artifact alone.

Limits and uncertainty

The source describes a generated fictional workplace, calibrated from patterns in work captured by Arbium; it does not establish that performance on HelixCove predicts performance in a real organization. The material does not provide comparative results for any model or agent, nor does it specify a leaderboard, licensing terms, or deployment guidance. The 430 questions have known answers, but the source does not state how broad their coverage is across the 59,768 actions or how difficult particular model classes find them. Screen recordings and accessibility-tree text may also make this a different evidence environment from a live enterprise system with its own permissions, policies, and data quality.

Skill to build now

Add a context-recovery test to one agent workflow this week. Choose a task with a handoff across at least two tools, then write questions that require the agent to identify the current owner, the latest relevant change, the evidence behind its answer, and whether the available record is insufficient. Score those separately from whether the agent produced the final file or clicked the intended control. This turns “it completed the task” into a testable claim about what the system understood.

Reader takeaway

HelixCove is a benchmark resource for a harder version of computer use: recovering a shared workplace history rather than executing a single interface procedure. For builders, the useful lesson is to evaluate contextual continuity, changing ownership, and justified uncertainty alongside task completion.

Open question

Will systems that perform well on HelixCove’s trace questions also make fewer context and handoff errors in real, permissioned workplace environments?

Evidence / sources

  1. 1arbium.ai/helix-cove
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicCoding AgentsExplore the coding-agents topic hub.
  2. 02topicEvalsExplore the evals topic hub.
  3. 03archiveField NotesOpen the latest editorial analysis.
  4. 04source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract