Adrian Lastra 519ec7b3b3 fix(computer_use): parse (label) and = "value" AX element label forms ... The SOM/AX element list dropped labels for two extremely common cua-driver render forms, leaving the model unable to target elements by name: - [79] AXButton (Dark) -> parenthesised label - [4] AXStaticText = "Wi-Fi" -> = "value" form - [92] AXPopUpButton = "Automatic" -> = "value" form The old regex only matched quoted "label" and id=Label, so System Settings buttons/text/popups all surfaced with empty labels. That's why selecting the macOS Appearance 'Dark' button by element index required guessing — the labels weren't available to aim with. Fix: extend _ELEMENT_LINE_RE to capture all four label forms (= "value", "quoted", (parenthesised), id=Label), skipping a pure-digit (N) order number in favour of the id= label. Verified live against System Settings: the Appearance buttons now surface as Auto/Light/Dark. Adds a regression test covering all label forms. Full suite: 84 passed.		2026-07-05 05:36:31 -07:00
..
__init__.py	feat(computer-use): cua-driver backend, universal any-model schema	2026-05-08 11:07:38 -07:00
backend.py	feat(computer_use): cross-platform cua-driver (macOS/Windows/Linux)	2026-06-22 06:42:30 -07:00
cua_backend.py	fix(computer_use): parse (label) and = "value" AX element label forms	2026-07-05 05:36:31 -07:00
doctor.py	feat(computer_use): disable cua-driver telemetry by default, add opt-in (#50842)	2026-06-22 09:57:16 -07:00
permissions.py	revert(windows): roll back terminal-popup PRs #53791 #53810 #53829 (#53853)	2026-06-27 15:59:00 -07:00
schema.py	feat(computer-use): add whole-screen/desktop capture target	2026-06-22 12:21:58 -07:00
tool.py	fix(computer_use): reconcile Linux gate with stale "gated off" comments	2026-06-22 06:42:30 -07:00
vision_routing.py	fix(computer_use): honor custom vision routing	2026-06-07 02:09:20 -07:00