Tool
esp32-iphone-agent
onehumanbeing/esp32-iphone-agent
What it is
A Swift iPhone app plus ESP32 board firmware that lets a vision model look at an iPhone screen over AirPlay and tap, swipe and type through a USB mouse and keyboard.
Who it might suit
Anyone experimenting with computer-use agents on a physical iPhone, without a Mac or developer account.
What to check first
The agent can operate any app a person could, through a pointer the board emulates, and screenshots go to the vision model you configure. The README says the free shared model line can be busy or fail. The app is on TestFlight.
How it runs
iPhone app with ESP32 board
Written
