CLI
Computer automation commands
Desktop automation commands for macOS via the `omniscout computer` sub‑command.
OmniScout now supports desktop (computer) automation on macOS. The computer sub‑command lets agents interact with native applications, windows, the clipboard, and the screen, extending the agent's capabilities beyond the browser.
Core commands
| Command | Syntax | Description |
|---|---|---|
navigate | omniscout computer navigate <target> [--session <id>] | Opens a file, URL, or application using macOS open. Sets the session’s active app for subsequent actions. |
type | omniscout computer type <text> [--session <id>] | Sends keystrokes to the active app. The backend ensures the app is foreground before typing. |
key | omniscout computer key <combo> [--session <id>] | Sends a keyboard shortcut (e.g., cmd+n). |
screenshot | omniscout computer screenshot [--out <path>] [--session <id>] | Captures the screen (or active window) via macOS screencapture. Returns the file URL. |
clipboard get | omniscout computer clipboard get [--session <id>] | Returns current clipboard contents (pbpaste). |
clipboard set | omniscout computer clipboard set <text> [--session <id>] | Replaces the clipboard (pbcopy). |
window list | omniscout computer window list [--session <id>] | Lists open windows (title and bundle identifier) using AppleScript. |
window activate | `omniscout computer window activate <title | id> --confirm --session |
window close | `omniscout computer window close <title | id> --confirm --session |
wait | omniscout computer wait <ms> [--session <id>] | Simple sleep for the given milliseconds. |
Session model & safety
- Session‑bound target app – After
navigateorwindow activate, the daemon records the app identifier.typeandkeyautomatically refocus this app, preventing accidental input to the wrong window. - Accessibility permission – All System Events calls verify macOS Accessibility permission. If missing, the command returns a
requires_usererror with instructions. - Destructive confirmation – Commands that can close windows require
--confirmto avoid data loss. - Action history – All computer actions are logged in the daemon’s history for replay, audit, and debugging.
Quick usage example
# Open Apple Notes and type a message
omniscout computer navigate "Notes" --session notes-demo
omniscout computer type "Hello from OmniScout!" --session notes-demo
# Take a screenshot of the active window
omniscout computer screenshot --out /tmp/notes.png --session notes-demo
For the full technical overview, see the Computer automation report in the repository (reports/computer_features.md).