Field noteOct 30, 20265 min read1 source

PokeBot opens RoboAPI, a free technical-preview API that drives robot arms zero-shot from a wrist camera and plain-English instructions

In one minute

PokeBot has opened RoboAPI, a free technical-preview API for controlling robot arms from wrist-camera observations, robot state, and a plain-English instruction. It matters because robotics teams can now test the company’s claimed zero-shot policy on their own hardware rather than judge it only through demonstration videos.

What changed: PokeBot adds RoboAPI, a free technical preview for zero-shot robot-arm control using a wrist camera and plain-English instructions, alongside Dream-1’s public API.

What happened

PokeBot has launched RoboAPI as a public technical preview for robot-arm control. The company describes the service as an API intended to make zero-shot generalization accessible: a developer supplies a robot’s observations and state together with a natural-language instruction, and the system returns the next action chunk in near real time. The stated aim is to let a robot perform a new requested task without a new collection-and-training cycle for that task.

The API is powered by Poke-Aurora, which PokeBot calls its first world-action model. According to the supplied product material, the model jointly predicts future video frames and robot actions through a technique named Modulated Residual Coupling; PokeBot says a technical report will follow. Its post-training target is a UMI-style setup: one wrist-mounted fisheye action camera and end-effector pose control. The company says an arm with adequate inverse kinematics can connect to the service. The launch material shows examples involving UR7e and UR5e arms, Franka FR3 and Panda systems, YAM, and a floating-base Tianji platform.

PokeBot frames the release as an alternative to the customary adaptation cycle in embodied AI. Robots differ in mechanics, sensors, and control methods, the company notes, so making an embodied foundation model available does not normally eliminate the need for data collection, training, evaluation, and repeated collection. RoboAPI is meant to move some of that work behind a hosted interface. Developers can view documentation and try the API through PokeBot’s platform.

The company’s examples cover instructions such as opening a drawer, putting objects into baskets, stacking cups, wiping a spill with a towel, inserting pens into a holder, and standing bottles upright. PokeBot says it tested robots in dozens of settings internally, and that external beta participants used their own robots and everyday objects in labs across multiple locations. These are demonstrations of selected tasks, not a disclosed independent evaluation.

PokeBot also reports results from its own benchmark, built around roughly 10,000 instructions and about 1,000 objects. It reports 86.0% on transfer and organization, compared with Astra at 71.3%, pi0.5 at 30.9%, and MolmoAct2 at 26.9%; 87.7% on environment interaction; and 54.1% on pose and shape alignment. The benchmark is self-built and PokeBot says results can vary. During the technical preview, RoboAPI is free for everyone, but only for non-commercial use; the terms exclude providing services to for-profit third parties.

What the archive adds

This is a new fact in the emerging story of robotic foundation models becoming accessible through product interfaces, rather than a restatement. Physical Intelligence’s Pi API beta made fine-tuning and hosting an adaptation workflow available. Dream-1 also arrived with a public robot-control API. RoboAPI’s distinctive claim is hosted, zero-shot operation across arm types using a wrist camera and instruction.

Trend signal

No supplied pattern is genuinely specific enough to establish a broader trend from this single, self-reported robotics API preview.

Why it matters

For an embodied-AI team, the release lowers the immediate cost of a serious compatibility test. Instead of first assembling a per-task dataset and training a policy, a team with a suitable arm, camera placement, and inverse-kinematics layer can test whether the API handles its objects, workspace, instructions, and failure modes. That is useful even if the service does not meet its broad generalization claim: it creates a faster way to identify where a hosted policy transfers and where a bespoke control stack is still required.

The commercial constraint matters equally. A free, non-commercial preview is appropriate for evaluation and research, but it is not evidence that a production deployment can be licensed, supported, or economically justified. Teams should treat RoboAPI as an experimental dependency and preserve a reproducible baseline of their current controller.

Limits and uncertainty

The available evidence is primarily PokeBot’s product material and reported results. The source does not provide the promised technical report, full benchmark protocol, task-level failure data, latency measurements, safety guarantees, API quotas, hardware installation requirements, or a commercial price. Its comparisons come from a company-built benchmark, so they do not independently establish superiority over Astra, pi0.5, or MolmoAct2. Demonstration videos and external-beta examples show that selected tasks ran; they do not establish reliable performance across homes, factories, unseen tools, varied lighting, or safety-critical settings.

Skill to build now

Build a small evaluation harness before connecting a robot to a hosted policy. Define a fixed set of workspace setups, natural-language instructions, reset rules, completion criteria, and intervention logging. Run the same set repeatedly, record success and recovery behavior rather than only final success, and separate failures caused by perception, grasping, motion planning, or instruction interpretation. That gives a team evidence for deciding whether a zero-shot API reduces adaptation work on its own hardware.

Reader takeaway

RoboAPI turns PokeBot’s robot-control claims into something outside teams can test: a free, non-commercial endpoint for wrist-camera-guided arm tasks. The important question is not whether its demos look capable, but whether its reported transfer survives a disciplined evaluation on a team’s actual robot, objects, and operating constraints.

Open question

Will PokeBot publish enough benchmark methodology, latency data, and technical detail for external teams to distinguish genuine cross-hardware transfer from performance tuned to the API’s target setup?

Evidence / sources

  1. 1pokebot.com/ai
All Field Notes

Next reads

Read next

Open the graph
  1. 01archiveField NotesOpen the latest editorial analysis.
  2. 02source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract