plugins/_a0_connector/skills/host-computer-use-macos/SKILL.md
Use this after host-computer-use when the connected A0 CLI reports the macOS computer-use backend.
Do not use this skill for Linux, Windows, Xpra, Docker, or browser-only tasks. If the backend is not macOS or does not advertise Accessibility-tree support, skip AX actions and follow the generic host computer-use rules.
macOS backends can advertise structural Accessibility features:
accessibility-tree-snapshotaccessibility-structural-targetingaccessibility-element-clickWhen these features are present, prefer structural targeting over pixel clicks for named controls such as buttons, menu items, text fields, sheets, alerts, toolbar items, and sidebar rows.
Use ax_snapshot to inspect the frontmost app's bounded Accessibility tree:
{
"tool_name": "computer_use_remote",
"tool_args": {
"action": "ax_snapshot",
"max_depth": 4,
"max_nodes": 200
}
}
The snapshot returns element paths, roles, labels, frames, enabled/focused state, actions, and child nodes. Use it to choose an element, not as final visual proof.
Use ax_action for a structural action:
{
"tool_name": "computer_use_remote",
"tool_args": {
"action": "ax_action",
"target": {
"role": "AXButton",
"title": "OK"
},
"operation": "press"
}
}
Supported operations are:
press: activate a button, menu item, checkbox, or similar controlfocus: focus a text field or focusable elementset_value: set a value; pass value or textTargeting options:
target when the control has a stable title, description, value, identifier, role, or subrole.path returned by the latest ax_snapshot only while the UI is unchanged.AX actions are attempts, not proof. They attach a fresh screenshot after state-changing actions; inspect that image before saying the requested outcome happened.
For active-app window tasks, macOS shortcuts are usually:
Command+H: hide the active appCommand+M: minimize the active windowTreat these as attempts. After any hide or minimize shortcut, inspect the fresh screenshot. If the target window is still visible, say the attempt failed or switch strategy; do not type follow-up text into the focused app unless the screenshot clearly shows the intended target.
When a visible close/minimize/full-screen button or menu item is accessible in the AX tree, prefer ax_snapshot plus ax_action over a small coordinate click.
macOS Screen Recording affects screenshots. Accessibility/Input Monitoring affect structural targeting and input. If computer_use_remote returns COMPUTER_USE_REARM_REQUIRED, COMPUTER_USE_APPROVAL_REQUIRED, or status=rearm required, stop immediately and ask the user to run /computer-use on in the A0 CLI and approve the macOS prompt if shown.
Do not bypass a permission failure with server screenshots, Docker commands, linux-desktop, or browser fallbacks.