Files
callstack__agent-device/test/integration/interaction-contract/runtime-selector.coverage.ts
Michał Pierzchała 5c5fa012f7 feat: --settle returns the settled diff in the interaction response (#1101) (#1106)
* feat: --settle returns the settled diff in the interaction response (#1101)

press/click/fill/longpress --settle executes the action, waits for the UI
to go quiet (wait stable's loop, shared via stable-capture.ts), and returns
the settled diff vs the pre-action tree in the same response — one round
trip instead of the interact -> observe pair.

- payload: changed lines only (bounded), summary counts, added-line refs,
  refsGeneration; best-effort (settled:false + hint on never-quiet content,
  never an action failure); --verify shares the settle captures
- ref issuance: the settled tree becomes the session snapshot; a
  diff-carrying settle response clears snapshotRefsStale and the MCP layer
  merge-only re-pins added-line refs at the settle generation
- grammar: --settle + --settle-quiet <ms> + --timeout <ms> (flag-sourced
  descriptor budget with new envelope:'widen' semantics mirroring wait)
- ADR 0011: new settleObservation guarantee classified on every path with
  contract scenarios per enforced/delegated cell

* test: give the two contention-flaky doctor scenarios explicit budgets

The doctor provider scenarios sit at ~5s of real daemon-harness work on a
loaded host and flake at vitest's 5s default during full-suite runs (the
known contention flake AGENTS.md documents). Same in-file precedent as the
Metro-probe scenario's 10s budget.

* fix: move SettleParams to contracts to satisfy the layering DAG

daemon/handlers/interaction-flags.ts imported the type across the
daemon -> commands boundary (R2 commands-floor). The tuning params are
part of the interaction contract like SettleObservation, so they live
in contracts/interaction.ts and both layers import from there.

* feat: keep settle diffs content-first — drop Key nodes, added lines win the cap

Bluesky dogfood: a fill that summons the iOS keyboard spent 49 of the 80
capped diff lines spelling out QWERTY keys, and a screen transition with
269 removals could starve out the added lines entirely. Key-type nodes
are now filtered from both diff sides (the [keyboard] container line
still signals presence), and under truncation added lines — the ones
carrying fresh refs — win slots over removals.

* docs: state the core loop in the top-level help starting point

Benchmarked with headless haiku/sonnet agents given only --help: both
models skipped the help-workflow pointer and started with plain
snapshot (38KB payloads they then had to re-read from files). One
core-loop line at the starting point is what teaches snapshot -i and
--settle to models that never read a second help page.

* fix: preserve settle digest refs for mcp

* fix: reduce settle fallow complexity

* fix: surface settle output in CLI text

* fix: complete settle handling for longpress

* refactor: localize daemon timeout envelopes

* refactor: deepen post-action observation

* refactor: centralize post-action observation planning

* refactor: derive settle capability from descriptors

* refactor: trim settle descriptor helpers
2026-07-06 20:18:44 +02:00

22 lines
1.1 KiB
TypeScript

import { definePathCoverage } from './coverage-manifest.ts';
export const RUNTIME_SELECTOR_COVERAGE = definePathCoverage('runtime-selector', {
disambiguation: 'runtime-selector disambiguation: visible tab wins over the closed-drawer twin',
occlusion: 'runtime-selector occlusion: covered button is refused',
offscreen: [
'runtime-selector offscreen: closed drawer refused with offscreen_selector',
'runtime-selector offscreen: edge-grazing container is still refused',
],
nonHittable: 'runtime-selector nonHittable: non-hittable match is annotated but still tapped',
responseConstruction:
'runtime-selector responseConstruction: daemon press response carries the canonical selector field set',
responseIdentity:
'runtime-selector responseIdentity: result echoes selectorChain and the resolved node',
verifyEvidence:
'runtime-selector verifyEvidence: press --verify returns a digest with change detection',
settleObservation:
'runtime-selector settleObservation: press --settle returns the settled diff with fresh refs',
errorTaxonomy:
'runtime-selector errorTaxonomy: no-match failure carries the shared code and hint',
});