agent-desktop/docs
Lahfir 5ed56337ac
feat: windows semantic action tier (sub-phase 2.7) (#122)
* docs: add sub-phase 2.7 semantic action tier plan

* feat: measure windows semantic action write surface (A19)

Probe area 19 establishes COM-stack viability for the 2.7 dispatch tier —
pattern invoke, failure taxonomy, secure writes, SetFocus foreground, Legacy
click, combobox/ladder geometry, and cost — so later units implement against
measured branches rather than inference.

Co-authored-by: Cursor <cursoragent@cursor.com>

* feat: add windows mutation classifier and retrofit ScrollIntoView

Write failures classify through one UiaFailure table with pinned code and
disposition arms; ScrollIntoView keeps observation-owned delivery while
overlays classifier code and platform detail. Scan governance covers every
mutation file before new pattern call sites land.

Co-authored-by: Cursor <cursoragent@cursor.com>

* feat: wire windows execute_action with click chain and honest arms

Override ActionOps::execute_action so Click runs Invoke then Legacy
DoDefaultAction (A19-6), SetFocus is headed-gated (A19-5), and every other
Action variant returns a deliberate outcome instead of the trait default.

Co-authored-by: Cursor <cursoragent@cursor.com>

* feat: add windows value writes with secure-field withholding

SetValue and Clear dispatch through Value and RangeValue chains; IsPassword
tri-state gates every value re-read so secrets are never echoed and secure
writes report verified none with delivered_unverified honesty.

Co-authored-by: Cursor <cursoragent@cursor.com>

* feat: add windows toggle and disclosure semantic actions

Headless Toggle/Check/Uncheck and Expand/Collapse run through pattern
chains with observed-state verification, tri-state double-toggle (A19-2),
and LeafNode fall-through instead of blind Invoke.

Co-authored-by: Cursor <cursoragent@cursor.com>

* feat: add windows select and scroll semantic actions

Select resolves names through SelectionItem self-match or bounded descendant
search with expand-first combobox handling; Scroll drives ScrollPattern with
per-axis honesty and percent or bounds verification.

Co-authored-by: Cursor <cursoragent@cursor.com>

* feat: add windows ancestor scroll ladder for ScrollTo

Non-ScrollItem targets scroll into view through ScrollPattern ancestors with
geometry-directed increments and the 2.6 visibility predicate; unsupported
terminals remain only when no scrollable ancestor exists.

Co-authored-by: Cursor <cursoragent@cursor.com>

* test: pin windows action envelope parity and cost baseline

Serialize ActionResult and classifier dispositions against the macOS wire
shape in CI, and keep the A19-8 min/median/max cost captures as the tier's
first hot-path baseline.

Co-authored-by: Cursor <cursoragent@cursor.com>

* docs: dogfood windows semantic action tier against live targets

Drive the release binary through Notepad, Explorer, scratch fixtures, and
Obsidian; judge by quoted envelopes so click no longer names execute_action
and residuals land with owning scopes.

Co-authored-by: Cursor <cursoragent@cursor.com>

* docs: align phases and skills with shipped windows semantic actions

Correct execute_action naming, Legacy click and SetFocus policy, mutation
classifier and secure-field vocabulary, and the platform actions folder map so
the product docs match A19 and the 2.7 dogfood.

Co-authored-by: Cursor <cursoragent@cursor.com>

* style: rustfmt windows semantic action modules

Co-authored-by: Cursor <cursoragent@cursor.com>

* refactor: share windows action write helpers across modules

Lift classify_write, verification window capping, and scroll/visibility
predicates into shared helpers so per-action modules stay thin without
changing delivery semantics.

Co-authored-by: Cursor <cursoragent@cursor.com>

* fix: honor post-delivery disposition and ladder absence honestly

Map toggle/disclosure observation failures after a real write through
after_delivery, refuse to count ScrollPattern absence as ladder delivery, and
split oversized dispatch tests under the 400-line cap.

Co-authored-by: Cursor <cursoragent@cursor.com>

* fix: export ladder absence pin for unit coverage

Co-authored-by: Cursor <cursoragent@cursor.com>

* style: drop non-doc comments from envelope parity tests

Co-authored-by: Cursor <cursoragent@cursor.com>

* fix: stop silent wrong delivery in select, scroll, and toggle

Duplicate SelectionItem names now return AMBIGUOUS_TARGET, ancestor
scroll refuses invented Down directions, Check/Uncheck no longer
Invoke-falls-through after an unverified Toggle delivery, and the UIPI
probe uses New-NotMeasuredResult so CI cannot silent-pass an unmeasured leg.

* fix: realize before select so virtualized duplicates stay ambiguous

A first-pass SelectionItem hit no longer skips scroll-to-realize or
short-circuits the second search, so a below-fold duplicate can still
surface as AMBIGUOUS_TARGET before Select fires.

* fix: keep select ambiguity and scroll disposition honest across steps

Retain the first SelectionItem match across realize/re-search so a
duplicate revealed only after scrolling is AMBIGUOUS_TARGET, and stamp
later ladder scroll failures delivered_unverified once the viewport moved.

* fix: search select matches after every realize scroll window

Virtualized lists can expose same-name items only between scroll steps; searching solely at the end misses intermediate duplicates and keeps a silent first hit.

---------

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-07 18:58:05 -07:00
..
brainstorms chore: track planning artifacts with secret and privacy scanning (#109) 2026-07-26 01:41:55 -07:00
dogfood-reports feat: windows semantic action tier (sub-phase 2.7) (#122) 2026-08-07 18:58:05 -07:00
plans feat: windows semantic action tier (sub-phase 2.7) (#122) 2026-08-07 18:58:05 -07:00
solutions feat: windows actionability and occlusion (sub-phase 2.6) (#121) 2026-08-07 04:22:29 -07:00
architecture.excalidraw docs: add architecture diagram to README 2026-02-24 06:22:52 -08:00
architecture.html refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
architecture.png refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
example.html refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
example.png refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
faq.md feat!: implement Playwright-grade foundation contract 2026-07-20 00:21:38 -07:00
json-output.md feat: windows resolution and live locator (sub-phase 2.5) (#120) 2026-08-06 16:14:04 -07:00
phases.md feat: windows semantic action tier (sub-phase 2.7) (#122) 2026-08-07 18:58:05 -07:00