CUA

Active
GitHub HTML MIT

Description

CUA provides open-source infrastructure for Computer-Use Agents, including sandboxes, SDKs, and benchmarks to train and evaluate AI agents that control full desktops (macOS, Linux, Windows).

Key Features

  • Cua Driver: background computer-use agent without stealing cursor focus
  • Cross-platform sandboxes: unified API for macOS, Linux, Windows, Android
  • CuaBot: multi-agent computer-use sandbox CLI with native window display
  • Cua-Bench: OSWorld, ScreenSpot benchmarks and RL environments
  • Lume: near-native performance macOS virtualization on Apple Silicon
  • Integration with Claude Code, OpenClaw, Cursor and other major agent frameworks

Use Cases

💡 AI agents autonomously operating desktop applications for complex tasks
💡 Cross-platform GUI automation testing and regression verification
💡 Building reproducible computer-use agent benchmarks
💡 Running untrusted code or browser automation in secure sandboxes

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (22.1k stars)
  • Permissive open-source license (MIT)

Quick Start

Install Python package: pip install cua, create a sandbox with Sandbox.ephemeral(Image.linux()), control the desktop via sb.shell.run(), sb.screenshot(), sb.mouse.click() and other APIs.

Related Projects

Vision Agents

8.1k · Python
Active A+

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider, using Stream's edge network for ultra-low latency realtime interactions.

voiceagentpython +3
  • · Real-time video AI with YOLO, Roboflow integration combined with Gemini/OpenAI for live visual understanding
  • · Ultra-low latency audio/video under 30ms via Stream's edge network with 500ms join time
  • · Native SDK methods from OpenAI, Gemini, and Claude for always-latest LLM capabilities

OpenSandbox

14.9k · Go
Active A

OpenSandbox is an open-source, secure, fast, and extensible sandbox runtime for AI agents, developed by Alibaba.

sandboxai-infrastructurekubernetes +2
  • · Multi-language SDKs: Python, Java/Kotlin, JavaScript/TypeScript, C#/.NET, and Go with unified sandbox APIs
  • · Docker and Kubernetes runtimes: built-in lifecycle management for both local development and large-scale distributed scheduling
  • · Strong isolation: supports gVisor, Kata Containers, and Firecracker microVM secure container runtimes