Anthropic just gave its AI assistant a set of hands. Claude can now directly control macOS applications, performing mouse clicks, keyboard inputs, and screen captures across desktop apps, all while running quietly in the background so users can keep doing their own thing.
The feature, available through the Claude Desktop app for Pro and Max subscribers, represents one of the most tangible steps yet toward AI agents that don’t just talk about doing work but actually do it.
How it actually works
The new capability runs on macOS 15 (Sequoia) and later, defaulting to background mode. Rather than commandeering your mouse and keyboard, Claude operates in separate windows while you continue using your machine normally.
When traditional API connectors aren’t available for a given app, Claude falls back on screen capture and input simulation to get things done. It can read what’s on screen, figure out where to click, and type responses into fields, essentially mimicking how a human would interact with software that wasn’t built with AI integration in mind.
