131 Commits

Author SHA1 Message Date
Michał Pierzchała 3bb5e6c6a8 fix: prevent APK file paths from being used as package names in adb run-as (#204)
resolveAndroidApp treated any input containing a dot as a package name,
which caused APK file paths (e.g. /path/to/app-debug.apk) to flow through
as appId into runtime hints, failing with a misleading "app not debuggable"
diagnosis. Android package names never contain slashes, so exclude paths
with '/' from the dot-based package heuristic.

Also differentiate probe failures in writeAndroidDevPrefs: check
isAndroidRunAsDeniedOutput on the probe result so connectivity/transport
errors are not misattributed to debuggability.

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-12 12:28:22 +01:00
Michał Pierzchała 3847958067 fix: serve artifact downloads at /upload/{id} to fix proxy 404 (#205)
The artifact download endpoint was at GET /artifacts/{id}, but proxies
in the sandbox → proxy → daemon architecture only forward known paths
(/rpc, /health, /upload). Move downloads to GET /upload/{id} so they
share the already-forwarded /upload path (POST for uploads, GET for
downloads).

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-12 12:28:11 +01:00
Michał Pierzchała ee7f81b8ab fix: write android runtime hints via stdin (#203) 2026-03-11 16:10:57 +01:00
Michał Pierzchała 3763772734 fix: clarify android runtime hint failures (#202) 2026-03-11 14:56:15 +01:00
Michał Pierzchała 63d9f0021c refactor: extract daemon orchestration into dedicated modules (#160) (#198)
Restore src/daemon.ts to thin-router entrypoint by extracting:
- server-lifecycle.ts: lock/info file management, code signature, env parsing
- request-router.ts: request dispatch orchestration across handlers
- transport.ts: socket server, listen helpers, disconnect/abort logic

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-10 10:27:17 +01:00
Michał Pierzchała 8b36c2a56c feat: support remote runtime hints and artifact retrieval (#199)
* feat: add remote runtime hints and artifact retrieval

* fix: apply session runtime transport hints on open

* fix: secure and time out artifact downloads
2026-03-09 19:50:40 +01:00
Michał Pierzchała a463106eea fix: avoid canceling active HTTP RPC requests (#196) 2026-03-09 17:34:52 +01:00
Michał Pierzchała 4a22da9e4b fix: propagate AbortSignal on cancellation to stop iOS runner promptly (#194)
* fix: propagate AbortSignal on request cancellation to stop iOS runner promptly

When a client disconnects (socket close or HTTP connection drop), in-flight
iOS runner operations now receive an AbortSignal that immediately interrupts
pending HTTP fetches, retry delays, and retry loops—ensuring detached
xcodebuild/runner processes are not driven after the parent workflow is canceled.

Closes #193

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix: ensure HTTP disconnect cancellation always propagates

* fix: rethrow canceled runner waits before fallback

* fix: harden cancellation tracking and propagation

---------

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-09 16:37:22 +01:00
Michał Pierzchała 780ecbc7a4 feat: support installing local artifacts over remote daemon transport (#192)
* feat: support installing local artifacts over remote daemon transport

When the CLI runs on a different machine than the daemon (via
AGENT_DEVICE_DAEMON_BASE_URL), install/reinstall commands now
transparently upload local app binaries (.apk/.ipa/.aab) and app
bundles (.app dirs) to the daemon before installing. No new flags
required — same CLI ergonomics.

- Add POST /upload endpoint to daemon HTTP server with auth and
  streaming file/tar reception
- Add client-side upload helper with timeout and tar packing for
  .app directories
- Intercept install/reinstall in sendToDaemon for remote daemons,
  upload artifact, rewrite positional path
- Clean up uploaded temp files after install completes (or fails)
  with 5-minute safety-net auto-cleanup for abandoned uploads
- Sanitize artifact filenames to prevent path traversal

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix: harden remote artifact upload flow

* refactor: split upload registry from receiver

---------

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-09 16:10:31 +01:00
Jonathan Sweet 21b6b61757 test: add unit tests for dispatch-series helper functions (#190)
* test(dispatch-series): add comprehensive unit tests for helper functions

* test(dispatch-series): mock setTimeout instead of measuring elapsed time
2026-03-06 17:06:02 +01:00
Michał Pierzchała 3bafc24f05 fix: support explicit remote daemon endpoints (#189)
* fix: support remote daemon base url

* fix: harden remote daemon endpoint handling

* docs: update remote daemon skill guidance
2026-03-06 15:40:06 +01:00
Michał Pierzchała 9ca4e07feb chore: tighten ios screenshot fallback diagnostics 2026-03-06 14:02:58 +01:00
Michał Pierzchała 1d875bacdc fix: harden ios screenshot fallback timeouts 2026-03-06 14:01:00 +01:00
Michał Pierzchała 4df80afbc5 fix: strip pre-PNG garbage from Android screenshots on multi-display devices (#185)
* fix: strip pre-PNG garbage from Android screenshots on multi-display devices

On Android emulators with multiple displays (e.g. Galaxy Z Fold), `adb
exec-out screencap -p` writes a warning to stdout before the PNG data,
producing corrupt files.  Locate the PNG signature in the buffer and
discard everything before it.

https://claude.ai/code/session_01Lfb3WKqXCSqYtCg8dbS8JW

* refactor: simplify PNG stripping and test scripts

- Remove unnecessary ternary; subarray(0) is a no-op
- Replace hex-encoded printf mock scripts with file-based payloads

https://claude.ai/code/session_01Lfb3WKqXCSqYtCg8dbS8JW

* fix: trim Android screenshot output to complete PNG payload

---------

Co-authored-by: Claude <noreply@anthropic.com>
2026-03-04 10:10:47 +01:00
Michał Pierzchała e248c87634 test: lock find click JSON response to exact deterministic key set (#183)
Add strict key-set assertions to find click handler tests to prevent
accidental schema drift in the machine-consumed JSON response.

Closes #182

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-03 20:28:10 +01:00
Michał Pierzchała 22deb54ddb feat: add --shutdown option to close command for iOS simulator teardown (#176)
* feat: add --shutdown option to close command for iOS simulator teardown (#172)

When --shutdown is passed, close ends the session then runs xcrun simctl
shutdown on the associated simulator. Shutdown result (success, exitCode,
stdout, stderr) is included in the JSON response data.

The option is silently ignored for non-simulator targets (physical iOS
devices, Android). A shutdownSimulator override is injected into
handleSessionCommands for testability.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* docs: document close --shutdown option for iOS simulator teardown

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix: keep close --shutdown successful when simulator shutdown fails

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 20:00:10 +01:00
Michał Pierzchała bb06bafc65 feat: add ensure-simulator command for scoped iOS device sets (#179)
* feat: add ensure-simulator command for scoped iOS device sets (#169)

Adds a new first-class `ensure-simulator` command that ensures an iOS
simulator exists (and optionally boots it) inside a scoped device set,
without requiring custom simctl scripting outside agent-device.

Usage:
  agent-device ensure-simulator --device "iPhone 16" [--runtime <id>] [--boot] [--ios-simulator-device-set <path>]

JSON output includes udid, device, runtime, ios_simulator_device_set,
and whether the simulator was created vs reused.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* docs: document ensure-simulator in commands reference and skill

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 19:39:52 +01:00
Michał Pierzchała 427093d0b0 fix: return deterministic matched-target metadata for find click responses (#178)
* fix: return deterministic matched-target metadata for find click responses (#170)

On success, build the response from the matched snapshot node rather than
passing through whatever the underlying click/press handler returns.
Response now includes: ref, locator, query, and x/y derived from the
matched element's rect — all stable across runs.

Also makes `dispatch` injectable in `handleFindCommands` (matching the
pattern in `handleInteractionCommands`) and adds tests that assert the
deterministic shape and verify that non-deterministic platform runner
data does not bleed into the response.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* docs: document find click response shape in selectors and skill references

Add response shape documentation for `find "<query>" click --json` to:
- website/docs/docs/selectors.md (new "Response shape (click)" section)
- skills/agent-device/SKILL.md (guardrail note)
- skills/agent-device/references/snapshot-refs.md (new "find click response" section)

Follows the fix in #178 that made the response deterministic.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 19:39:31 +01:00
Michał Pierzchała 8d4c9149a6 fix: retry alert accept/dismiss on transient 'alert not found' errors (#177)
* fix: retry alert accept/dismiss on transient 'alert not found' errors

Adds a 2 s internal retry window for `alert accept` and `alert dismiss`
when the runner returns "alert not found" or "no alert". Errors from
other causes break the loop immediately and are re-thrown unchanged.
Also injects `runnerCommand` as an optional param to enable unit testing
without spawning a real runner.

Closes #171

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* docs: document alert accept/dismiss retry behaviour in skill and permissions reference

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 19:39:22 +01:00
Michał Pierzchała 43cb8cdb5d fix: enrich DEVICE_NOT_FOUND error for empty scoped iOS simulator sets (#175)
* fix: enrich DEVICE_NOT_FOUND error for empty scoped iOS simulator sets (#168)

When selectDevice finds no candidates and a simulatorSetPath context is
provided for iOS, throw a detailed error including the set path and a
suggested xcrun simctl --set ... create command to provision the first
simulator.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* docs: note enriched DEVICE_NOT_FOUND guidance for empty scoped iOS simulator sets

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 19:37:58 +01:00
Michał Pierzchała a51f8193f2 feat: include device_udid and ios_simulator_device_set in iOS JSON payloads (#180)
Add device identity fields to open, appstate, and session_list responses
for iOS targets, enabling isolation verification in concurrent multi-session
runs without extra simctl calls.

Closes #173

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 19:36:01 +01:00
Michał Pierzchała 5f941c13f6 refactor: split app-log backend into process/stream/platform modules (#161) (#174)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 18:46:22 +01:00
Michał Pierzchała 5628693aa3 fix: stabilize iOS simulator screenshot capture (#167)
* fix: stabilize iOS simulator screenshot capture

* refactor: extract iOS screenshot module

* fix: fallback to runner for flaky iOS simulator screenshots

* chore: harden simulator runner screenshot path resolution

* refactor: simplify simulator screenshot fallback flow
2026-03-03 18:15:49 +01:00
Michał Pierzchała d269da37e3 refactor: split dispatch into command-family modules (#157) (#164)
Extract resolveTargetDevice, series/jitter helpers, and push payload
parsing into dedicated modules to reduce dispatch.ts from ~706 to ~564 LOC.

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-03 18:11:14 +01:00
Michał Pierzchała c6910823df fix: harden daemon startup retries (#166) 2026-03-03 17:21:43 +01:00
Michał Pierzchała d38ddc6bb0 refactor: split iOS runner-client into focused modules (#163)
Break the 1129-LOC runner-client.ts into cohesive modules:
- runner-errors.ts: error classification, hints, error builders
- runner-xctestrun.ts: xctestrun discovery, build, preparation, build settings
- runner-transport.ts: HTTP transport, endpoint resolution, connection waiting
- runner-session.ts: session lifecycle, process management, device validation
- runner-client.ts: thin orchestration + re-exports (preserves all public API)

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-03 14:44:11 +01:00
Michał Pierzchała b6b7c6228a refactor: split session replay helpers into focused modules (#153) 2026-03-03 14:41:35 +01:00
Michał Pierzchała 1a3ae62510 refactor: split Android platform module into focused submodules (#162)
Break down the monolithic `src/platforms/android/index.ts` (~1533 LOC) into
focused submodules to improve maintainability and targeted code review.

New submodules:
- `adb.ts` (21 LOC) — shared helpers: adbArgs, ensureAdb, sleep, isClipboardShellUnsupported
- `app-lifecycle.ts` (507 LOC) — app resolve/list/open/close/install/reinstall/appstate + bundletool
- `input-actions.ts` (378 LOC) — press/swipe/longPress/type/fill/scroll/scrollIntoView
- `device-input-state.ts` (184 LOC) — keyboard state/dismiss + clipboard read/write
- `settings.ts` (314 LOC) — appearance/permission/fingerprint/wifi/airplane/location
- `notifications.ts` (61 LOC) — push notification broadcast
- `snapshot.ts` (98 LOC) — snapshot + screenshot + UI hierarchy dump
- `index.ts` (43 LOC) — thin re-export layer preserving all public exports

Closes #154

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-03 14:41:10 +01:00
Michał Pierzchała 9b0a3dee6e feat: add install command with ipa/aab support (#151)
* feat: add install command for in-place app deployment

* chore: document install vs reinstall in quick start and skill

* docs: clarify install format support and limits

* feat: support ipa and aab app installation

* feat: improve install flexibility for ipa and aab

* fix: retry iOS simulator screenshot surface timeouts

* refactor: simplify install resolution and boot handling
2026-03-03 14:14:23 +01:00
Michał Pierzchała 6c78472420 fix: harden iOS relaunch/close lifecycle to reduce simulator flakes (#152)
* fix: harden iOS relaunch and close runner lifecycle

* refactor: dedupe iOS relaunch close flow and tighten tests
2026-03-03 14:00:14 +01:00
Michał Pierzchała 8c30032ae4 perf: speed up iOS runner build-for-testing (#150)
* perf: speed up runner build-for-testing

* chore: drop redundant active-arch runner override

* test: run iOS simulator integration on CI by default
2026-02-28 14:13:39 +01:00
Michał Pierzchała 33d918d0f3 chore: cleanup old bundleIDs 2026-02-26 16:48:16 +01:00
Michał Pierzchała 14de55c9b7 fix: support configurable iOS runner bundle IDs (#146) 2026-02-26 16:40:24 +01:00
Michał Pierzchała b3ad24f527 feat: add Android keyboard status and dismiss command (#144) 2026-02-26 11:47:46 +01:00
Michał Pierzchała 890ceefe90 feat: add trigger-app-event aliases and routing (#134)
* feat: add trigger app event aliases and routing

* chore: remove redundant trigger normalization in session handler

* chore: remove trigger command aliases
2026-02-26 10:44:46 +01:00
Michał Pierzchała 4a38bb0b74 feat: add simulator-set and Android allowlist isolation (#143)
* feat: add simulator-set and Android allowlist isolation

* chore: document isolation scopes in agent-device skills
2026-02-26 10:38:23 +01:00
Michał Pierzchała 0c4b1251c6 fix: prevent Android fill/type truncation with + and @ (#142)
* fix: encode Android shell text input for special ASCII

* fix: harden android fill fallback strategy

* chore: simplify android fill fallback flow
2026-02-26 10:37:31 +01:00
Michał Pierzchała 2a86f52b05 fix: harden press @ref bounds recovery (#141) 2026-02-26 10:23:14 +01:00
Michał Pierzchała 74eee5a32e Fix Android boot completion and emulator launch modes (#138)
* Fix Android boot completion and headless emulator launch

* Refactor Android boot fast lookup for testability

* Avoid extra target probes in Android boot fast lookup

* Simplify Android boot path in session handler

* fix: enforce boot target and headless validation
2026-02-26 10:20:51 +01:00
Michał Pierzchała b685a0b259 Add remote HTTP daemon mode with lease admission controls (#136)
* fix: add daemon remote HTTP server mode with isolation controls

* feat: add tenant lease lifecycle and admission control

* refactor: simplify lease scope and rpc method routing

* fix: correct smoke expectations for close without session
2026-02-25 18:25:15 +01:00
Michał Pierzchała 803ba256d4 Add Touch ID and Android fingerprint simulation for settings (#135)
* fix: add touchid/fingerprint settings simulation and harden error handling

* chore: tighten agent docs and simplify iOS biometric settings flow
2026-02-25 17:38:43 +01:00
Michał Pierzchała f512b7d69c feat: add network dump command for session app traffic (#120)
* feat: add network dump command for session app traffic

* fix: restore cli branch block after rebase conflict
2026-02-25 16:17:08 +01:00
Nick Dima 43aae1d30a fix(ios): correctly implement runner fallback for physical device screenshots (#132)
* fix(ios): use XCTest runner for screenshots on physical devices

`xcrun devicectl device screenshot` was removed in Xcode 26.x, causing
`agent-device screenshot` to fail on physical iOS devices with exit code 64.

This fix routes physical device screenshots through the AgentDeviceRunner
XCTest runner (already used for snapshot/interaction commands) instead:

- Add `screenshot` command to the Swift runner's `CommandType` enum
- Implement the handler using `XCUIScreen.main.screenshot()`, writing a
  timestamped PNG to the app's temp directory (returned as `tmp/<file>`)
- If `appBundleId` is provided, activate the target app before capturing
  so the screenshot shows the app under test rather than the runner itself
- In `screenshotIos()`, pass `appBundleId` to the runner command then pull
  the file back to the host via `xcrun devicectl device copy from` (same
  mechanism used by the recording feature)
- Thread `appBundleId` through `Interactor.screenshot()` → `dispatch.ts`
  → `screenshotIos()` so the active session's app is always captured
- Extract `IOS_RUNNER_CONTAINER_BUNDLE_IDS` to `runner-client.ts` so it
  can be shared between `apps.ts` and `record-trace.ts`

Fixes: screenshots failing with "Failed to capture iOS screenshot" on
devices using Xcode 26.x / devicectl 506.6+

* fix: clean up iOS screenshot fallback follow-ups

---------

Co-authored-by: Michał Pierzchała <thymikee@gmail.com>
2026-02-25 16:11:01 +01:00
Michał Pierzchała 8123117e6d fix: fallback iOS/tvOS screenshot to runner when devicectl screenshot is unavailable (#130) 2026-02-25 15:34:14 +01:00
Michał Pierzchała ef20dea6bc feat: add AndroidTV and tvOS target support (#125)
* feat: add AndroidTV and tvOS target support

* feat: enable tvOS runner interactions

* refactor: unify apple target handling and tvOS capability gates

* refactor: remove hardcoded tvOS app-switcher sleep

* fix: align tvOS capabilities and docs for simulator-only helpers

* feat: improve AppleTV and AndroidTV physical device detection

* refactor: simplify tv target detection helpers
2026-02-25 14:55:54 +01:00
Michał Pierzchała 996d1fca2f feat: add session perf metrics command (#121)
* feat: add session perf metrics command

* refactor: simplify open perf result shaping

* docs: improve perf guidance in docs and skill

* docs: split perf guidance into skill reference
2026-02-25 13:49:59 +01:00
Michał Pierzchała ab338263ed feat: add clipboard read and write commands (#122) 2026-02-25 13:01:33 +01:00
Michał Pierzchała 66b0bdba31 fix: expose push notification simulation (#109)
* fix: expose push notification simulation across iOS and Android

* refactor: share push JSON detection and clean extras validation

* fix: harden push payload path handling in session

* refactor: consolidate push payload source resolution
2026-02-24 17:34:28 +01:00
Nils Fischer 8660b0433f feat: add settings appearance command (#119)
* feat: add settings appearance command

- add appearance light|dark|toggle support to settings command

- implement iOS simulator and Android night mode handlers

- cover parser/handler/platform behavior with unit tests

- update README, docs, and agent-device skill guidance

* test: align settings usage assertions

- expect split settings usage lines for wifi/location and appearance

* fix: harden settings appearance parsing and dedupe usage contract

---------

Co-authored-by: Michał Pierzchała <thymikee@gmail.com>
2026-02-24 17:25:56 +01:00
Michał Pierzchała ddfeb65896 fix: harden android non-ascii text input and document IME workaround (#118) 2026-02-24 16:53:30 +01:00