---
type: "raw_signal"
id: "open-source-project-lets-a-vision-model-drive-c99a00"
slug: "open-source-project-lets-a-vision-model-drive-c99a00"
title: "Open source project lets a vision model drive a stock iPhone via a $7 ESP32-S3 acting as USB mouse."
description: "ESP32 iPhone Agent is an open-source project for controlling a stock iPhone with a vision model."
retrieval_nugget: "ESP32 iPhone Agent is an open-source project for controlling a stock iPhone with a vision model."
observed_at: "2026-10-13"
record_date: "2026-10-13"
date_kind: "observed_at"
why_it_matters: "ESP32 iPhone Agent is an open-source project for controlling a stock iPhone with a vision model. Its README describes an AirPlay-based screen input path and a $7 ESP32-S3 board that connects to the phone as a USB HID mouse and keyboard. The project says it requires no Mac, developer account, or jailbreak and can use any OpenAI-compatible vision model. These are implementation details documented by"
novelty: "notable"
verification_level: "source-linked"
signal_type: "release"
source_platform: "github.com"
topics: []
entities: ["ESP32 iPhone Agent","ESP32-S3","iPhone"]
related_patterns: ["agent-ready-software-exposes-capabilities"]
source_url: "https://github.com/onehumanbeing/esp32-iphone-agent"
source_urls: ["https://github.com/onehumanbeing/esp32-iphone-agent"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "signal:open-source-project-lets-a-vision-model-drive-c99a00"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/signals/open-source-project-lets-a-vision-model-drive-c99a00/","markdown":"https://newruntime.com/signals/open-source-project-lets-a-vision-model-drive-c99a00.md","json":"https://newruntime.com/signals/open-source-project-lets-a-vision-model-drive-c99a00.json"}
---

# Open source project lets a vision model drive a stock iPhone via a $7 ESP32-S3 acting as USB mouse.

## Retrieval answer

ESP32 iPhone Agent is an open-source project for controlling a stock iPhone with a vision model.

ESP32 iPhone Agent is an open-source project for controlling a stock iPhone with a vision model. Its README describes an AirPlay-based screen input path and a $7 ESP32-S3 board that connects to the phone as a USB HID mouse and keyboard. The project says it requires no Mac, developer account, or jailbreak and can use any OpenAI-compatible vision model. These are implementation details documented by the repository, not independent validation of reliability, safety, or compatibility across devices.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- collection: [Raw Signals](https://newruntime.com/signals.json): Open every source-linked raw signal.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)