agent-desktop/docs
Lahfir 85f3b6e76a
feat: windows actionability and occlusion (sub-phase 2.6) (#121)
* docs: plan the windows actionability and occlusion work

* docs: close the critique round on the actionability plan

* test: measure windows actionability unknowns for hit-test and scroll

A18 probes pin ScrollIntoView observation arms, unclipped straddling
geometry, hang-bounded ElementFromPoint, virtual-screen Unknown guards,
and WPF zero-size envelope staging before product code relies on them.

* feat: add windows hit_test with never-false-negative classification

ElementFromPoint classification reaches ReachesTarget or Unknown under
the closed Err set, with virtual-screen and minimized guards so phantom
desktop hits cannot become false interceptions before corroboration.

* feat: corroborate windows hit_test interception with window attribution

InterceptedBy fires only on the agreed same-root or cross-window arms,
with redaction-safe occluder evidence, so false negatives stay Unknown.

* feat: add windows scroll_into_view judged by observation

Gates ScrollItemAvailable and verifies delivery from re-reads so the
auto-scroll retry reports an honest unsupported outcome instead of
PLATFORM_NOT_SUPPORTED.

* test: pin windows actionability envelopes for disabled zero-bounds occlusion

Fake-driven checks keep macOS-parity codes and dispositions in CI, with
live disabled evidence and an opt-in WPF zero-bounds leg.

* test: dogfood windows actionability against foreign occluders

Exercises headed occlusion and scroll seams on real targets, unblocks
window resolve for the headed path, and records envelope-backed judgements.

* docs: align phases and concepts with windows actionability evidence

Restates the hit-test and scroll contract from A18/U6 measurements and
adds the shared actionability vocabulary the adapter now implements.

* docs: align phases and concepts with windows actionability evidence

Restates the hit-test and scroll contract from A18/U6 measurements and
adds the shared actionability vocabulary the adapter now implements.

* style: format windows actionability modules and harden live hit skips

Keeps rustfmt clean and soft-skips on-screen reachability when a foreign
desktop occluder covers the fixture under Cursor.

* fix: require viewport evidence for scroll verification

Missing viewport no longer counts as verified visibility, and the UIA
client is acquired before ScrollIntoView so post-invoke errors stay
observation-judged.

* fix: revalidate window ownership at the focus point of use

* style: fold probe commentary into doc comments

* docs: state the file-size cap's enforcement scope

* fix: qualify headed focus success by live window ownership

* fix: bound headed focus and window resolution by the operation deadline

* docs: record the window-focus surface and hand its policy depth to 2.9

* docs: tell agents what the windows actionability failures mean

* test: pin that focused only ever means owned foreground

* refactor: split window resolution tests into a sibling module

* test: execute the real scroll gate and ban the whole read table

* fix: make dogfood judgements reject the defects they hunt

* test: scan the occlusion gate for banned calls and name rendering

* test: make the windows lane stage the live wpf evidence it claims

* fix: budget the occlusion gate's walks and scope viewport demotion to same-root

* docs: state the measured deadline overshoot for the occlusion gate

* refactor: give the duplicated geometry and walker helpers one home

* fix: stop a discarded viewport walk from unmaking a settled verdict

* fix: make the live occlusion legs immune to desktop churn

* docs: give off-screen fixture parking a measurement owner

* test: dogfood the hardened occlusion gate and record the judgement rebuild

* docs: fold the actionability lessons into the solutions corpus

* fix: shrink the headed focus write surface to the foreground call

* fix: guard headed focus with full process identity at every point of use
2026-08-07 04:22:29 -07:00
..
brainstorms chore: track planning artifacts with secret and privacy scanning (#109) 2026-07-26 01:41:55 -07:00
dogfood-reports feat: windows actionability and occlusion (sub-phase 2.6) (#121) 2026-08-07 04:22:29 -07:00
plans feat: windows actionability and occlusion (sub-phase 2.6) (#121) 2026-08-07 04:22:29 -07:00
solutions feat: windows actionability and occlusion (sub-phase 2.6) (#121) 2026-08-07 04:22:29 -07:00
architecture.excalidraw docs: add architecture diagram to README 2026-02-24 06:22:52 -08:00
architecture.html refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
architecture.png refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
example.html refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
example.png refactor!: unify command execution contracts 2026-05-19 18:27:08 -07:00
faq.md feat!: implement Playwright-grade foundation contract 2026-07-20 00:21:38 -07:00
json-output.md feat: windows resolution and live locator (sub-phase 2.5) (#120) 2026-08-06 16:14:04 -07:00
phases.md feat: windows actionability and occlusion (sub-phase 2.6) (#121) 2026-08-07 04:22:29 -07:00