desktop automation

Native desktop automation CLI for AI agents. It controls apps through OS accessibility trees and returns structured JSON with deterministic element references, with extra FFI bindings for embedding in other languages.

Open-source infrastructure for computer-use agents, with sandboxes, SDKs, benchmarks, and desktop automation tooling for macOS, Linux, Windows, and Android. The repo also includes Cua Driver, CuaBot, Cua-Bench, and Lume for VM management.

A Windows desktop agent that lets AI interact with any app through visual GUI control, with a portable single-EXE build and support for ChatGPT, Gemini, and Claude.

Flue is an open-source Python tool that lets coding agents control desktop software from the command line without MCP servers. The README says it works with apps like Photoshop, Blender, Unity, Houdini, and Microsoft Office, and supports harnesses such as Claude Code, Codex, Gemini CLI, Cursor, and OpenCode.