AJ Learning Hub logoAJ Learning Hub

Computer Use

A Claude capability where the model controls a computer by viewing screenshots and issuing mouse and keyboard actions to operate software through its graphical interface.

Analogy

Like a remote worker who sees your screen and moves the mouse and types, rather than calling a clean API.

Why it matters

It lets you automate apps that have no API by having Claude drive the actual interface.

In practice

Claude opening a web app, filling a form, and clicking submit by interpreting on-screen screenshots.

Related terms:Tool CallingAgentClaude Model Tiers: Opus, Sonnet, HaikuGuardrails