hermes-agent/tools/computer_use
Dickson Neoh 08298dabbd fix(computer-use): handle Linux cua window metadata
Treat cua-driver's Linux `is_on_screen: null` as unknown instead of
off-screen, and skip GNOME Shell desktop/backdrop helper windows
(ding "Desktop Icons", @!x,y;BDHF) when selecting the default capture
target — they are targetable X11 windows but capture as empty.

Reconciled with the _NET_ACTIVE_WINDOW fallback from #58030: helper
windows are filtered out of the candidate pool first, then the tied
z-order active-window probe runs on the remaining real app windows.
Also falls back to the requested app name for _last_app when Linux
windows carry no app_name.

Salvaged from #54173 by @dnth.
2026-07-23 08:11:58 -07:00
..
__init__.py feat(computer-use): cua-driver backend, universal any-model schema 2026-05-08 11:07:38 -07:00
backend.py feat(computer_use): follow cua-driver's verify → escalate ladder (#67123) 2026-07-18 13:59:35 -07:00
cua_backend.py fix(computer-use): handle Linux cua window metadata 2026-07-23 08:11:58 -07:00
doctor.py fix: resolve cua-driver across computer-use surfaces 2026-07-23 00:42:46 -05:00
permissions.py fix: resolve cua-driver across computer-use surfaces 2026-07-23 00:42:46 -05:00
schema.py feat(computer_use): follow cua-driver's verify → escalate ladder (#67123) 2026-07-18 13:59:35 -07:00
tool.py perf(computer_use): cap capture size and cache vision routing 2026-07-23 00:52:43 -05:00
vision_routing.py fix(computer_use): honor custom vision routing 2026-06-07 02:09:20 -07:00