hermes-agent/skills/apple
Francesco Bonacci f2e37549c6 feat(computer_use): cross-platform cua-driver (macOS/Windows/Linux)
Make the computer_use toolset platform-agnostic by driving cua-driver on
macOS, Windows, and Linux. Consumes the 8 cua-driver decoupling surfaces
(capability discovery, structuredContent AX tree, opaque element_token,
click button enum, explicit mimeType, machine-readable manifest,
structured list_windows, structured health_report), each degrading
gracefully on older drivers.

Adds `hermes computer-use doctor` (drives cua-driver health_report with a
per-OS check matrix and an exit 0/1/2 ok/degraded/blocked contract), full
typed wrappers for the previously-uncovered cua-driver tools plus a generic
call_tool escape hatch, per-session agent-cursor lifecycle, platform-aware
system-prompt guidance (host-deterministic, cache-safe), and honors
HERMES_CUA_DRIVER_CMD end-to-end.

Replaces the macOS-only skills/apple/macos-computer-use skill with a
cross-platform skills/computer-use skill, and refreshes the EN + zh-Hans
docs.

Supersedes #44221 (Windows-enablement salvage of #30660).

Co-authored-by: Teknium <127238744+teknium1@users.noreply.github.com>
2026-06-22 06:42:30 -07:00
..
apple-notes docs(skills): compress 74 built-in skill descriptions to <=60 chars 2026-04-26 21:50:56 -07:00
apple-reminders docs(skills): clarify Reminders alarm timing 2026-05-29 04:01:01 -07:00
findmy docs(skills): compress 74 built-in skill descriptions to <=60 chars 2026-04-26 21:50:56 -07:00
imessage feat: secure skill env setup on load (core #688) 2026-03-13 03:14:04 -07:00
DESCRIPTION.md feat(computer-use): cua-driver backend, universal any-model schema 2026-05-08 11:07:38 -07:00