An AI agent for
your iPhone.

Open apps, change settings, and set alarms with a plain-language instruction. Connect an ESP32-S3 and choose a vision model. No jailbreak required.

Setup needs a Mac with Xcode. Once installed, tasks run with just your iPhone and the board.

The ESP32 Agent app showing task entry and saved tasks
ESP32 Agent app with an ESP32-S3 connection illustration.
~US$7Board only; model usage costs extra
iOS 18+USB-C, or Lightning with an adapter
Vision APIOpenAI-compatible, with image input

How it sees and controls your iPhone

The board receives the screen and sends mouse and keyboard input. The iPhone app connects to your model to decide each step.

Read how it works
01

See the screen

AirPlay sends the display to the board. It forwards the video over Bluetooth to the app on your iPhone.

02

Choose the next move

The app sends a screenshot to your vision model. A planner and actor turn your goal into actions.

03

Make it happen

The board acts as a USB mouse and keyboard. AssistiveTouch turns pointer movements into taps and swipes.

See it set a repeating alarm

Specify a time and repeat days. The agent opens Clock and edits the alarm. Replay the run afterward to inspect each action.

“Set an alarm for 8:00 AM every Monday and Tuesday, then save it.”

Demo details and task examples
An iPhone connected to an ESP32-S3 beside the legacy agent interface during an alarm task
This demo is from v0.1.0, which used a computer. The current agent runs in the iPhone app.

Set up in three steps

Follow the complete guide, or go straight to the step you need.

Check what it can do for your task

Currently supports portrait apps and ASCII keyboard input. Keep the phone unlocked; passcode screens, Apple Pay, and protected video cannot be seen.

Check requirements and limitations

Common questions

Do I need a Mac?

For initial setup, yes: the documented workflow uses a Mac to flash the board and build the iPhone app in Xcode. Once installed, the agent runs with just the iPhone and board.

Is the whole setup $7?

No. That is the approximate price of the tested ESP32-S3 board. You also need an iPhone, access to a Mac for setup, and a vision-model endpoint. Adapters, cellular data, and model usage may add costs.

Do I need to jailbreak my iPhone?

No. The board uses AirPlay screen mirroring and standard USB mouse and keyboard input through AssistiveTouch.

Does it work fully offline?

The current setup uses the board’s Wi-Fi hotspot for mirroring and cellular data to reach the model. A self-hosted model still needs an endpoint the phone can reach.

Ready to set it up?

Flash the board, install the app, and check your first task with the step-by-step guide.

Open the setup guide