# agent-desktop

Vercel Labs has released agent-desktop, which lets AI agents operate desktop apps on macOS, Windows and Linux without screenshots or pixel matching. It reads an app's accessibility tree as JSON, assigns a ref to every element the agent can act on, and the agent clicks or types on a ref, then reads the UI again to verify. The tool ships as a CLI and a C library, contains no model, and leaves the observe-act-verify loop in the agent.

Vercel Labs has released agent-desktop, which lets AI agents operate desktop apps on macOS, Windows and Linux without screenshots or pixel matching. It reads an app's accessibility tree as JSON, assigns a ref to every element the agent can act on, and the agent clicks or types on a ref, then reads the UI again to verify. The tool ships as a CLI and a C library, contains no model, and leaves the observe-act-verify loop in the agent.