Native phone appScreen-control agent

Phone Agent

An iOS app that combines shared-screen observation with an ESP32-S3 Bluetooth accessory.

What this project does

The app captures the screen the user shares, asks an image-capable model for actions, and sends them to a Bluetooth mouse and keyboard. Conversations and system integrations are part of the same app.

Limits and verification

The maintainer distributes development source, not a verified App Store installation. Pairing, pointer calibration and screen-sharing consent are required. No repository license was identified in the reviewed metadata.

Reviewed sources

Reviewed READMEa900450
Hardware
ESP32-S3; default firmware uses GPIO48 RGB
Runs on
Native iPhone app
Screen / observation
User-authorized full-screen sharing
Input path
Bluetooth HID mouse and ASCII keyboard
Setup requirements
iOS 27, Xcode 27, signing team and ESP-IDF 5.5.4
License information
Not identified in reviewed repository metadata