Native phone appScreen-control agent

Actell / 执言

An experimental CoreDevice agent with optional ESP32-S3 USB networking.

What this project does

Actell explores phone-side observation and touch actions through Apple’s CoreDevice channel. VPN loopback is the default connection route; an ESP32-S3 can provide an optional USB NCM relay. This is not a HID-only design.

Limits and verification

The author labels it an early prototype. Controlled screenshots and taps do not establish reliable complete tasks, dragging or long background sessions. ESP32 is optional rather than required for the default VPN route.

Reviewed sources

Reviewed READMEa0d9eed
Hardware
Optional ESP32-S3 with native USB for NCM
Runs on
Native iPhone app with Swift / Rust backend
Screen / observation
CoreDevice screen capture
Input path
CoreDevice touch actions
Setup requirements
iOS 27+, Xcode 27, signing, Developer Mode, pairing and matching developer disk image
License information
GPL-3.0