mirror of
https://github.com/software-mansion/argent.git
synced 2026-09-14 19:27:14 +08:00
b232114422
Audits every comment in `src/` and `scripts/` against the code it
describes.
**462 files, 57 commits, net −8,194 lines.** Comment text only — the
whole branch is code-identical to `main`.
## Method
One subagent per file, strictly sequential. Scope was `src/` +
`scripts/` (459 files); three more files were added at the end because
they carried dead references of the same kind — two test headers citing
design docs that do not exist, and `publish-npm.yml` citing a retired
workflow. Each agent verified every comment — line, block, JSDoc, file
header, trailing — against the surrounding code and the rest of the
repo, following identifiers, paths, tool ids, config keys, env vars and
issue links to see whether they still exist and still behave as
described. Rules:
- **A false or misleading comment is deleted, not reworded.** If a claim
could not be confirmed by reading the source, it went. That is why the
deletion count is so much larger than the rewrite count.
- Survivors are cut to the shortest form carrying something the code
does not already say. Restatement, preamble, hedging, changelog prose
and ASCII banners are gone; the non-obvious *why* stays.
- Preserved byte-identical: license headers, pragmas and directives
(`@ts-*`, `eslint-disable`, shebangs, `/// <reference>`), JSDoc tag
tokens, everything inside a string or template literal, and the sole
comment inside an otherwise empty block (ESLint `no-empty` counts a
comment-bearing block as non-empty).
## Verification
Every file passed two independent gates before being recorded as done:
1. `comments-only` — the required check.
2. A second comment-stripping comparator with a proper mode stack,
written for this pass because `comments-only`'s flat scanner desyncs on
nested template literals and quote-bearing regex literals and then
reports comment lines as code changes. Two files hit that false FAIL
(`utils/android-profiler/pipeline/index.ts`,
`scripts/extract-tools.mjs`); in both the "changed code" it printed was
literally `//` lines, and the second checker confirmed the code was
byte-identical.
After the last file, all 462 changed files were re-checked against
`main` with the same comparator, rather than trusting any agent's
self-report. **459 code-identical; 2 are non-code (`.svg`, `.md`); 1
intentional.**
The intentional one is `packages/argent/scripts/bundle-tools.cjs`: the
changed template literal *is* the comment header of the file it
generates, `packages/native-devtools-android/src/bundled-meta.ts`.
Fixing only the generated file would have been reverted by the next
build, so the generator changed too — and it has been verified to
reproduce the committed generated file byte-for-byte.
## Representative false claims removed
Not wording nits — statements a reader would have acted on:
- **Reversed directions.** `proxyStart`'s JSDoc had the tunnel backwards
(it is a reverse tunnel: the host binds first and the simulator dials
in). A `paste()` doc had the pasteboard copy direction reversed.
- **Contradicted by the code below it.** A timeout budget multiplied by
three where the probes run concurrently — the same comment said so six
lines later. A "warn once" that warns on every call. A "binary search"
that is a linear scan.
- **Named things that do not exist.** A `vega-fast-cli` binary, a
`finish-recording.ts`, a `publish-next.yml` workflow, two
`profiler-react19-*.md` design docs, a `DebuggerTarget.ts`, a commit
hash git does not know, two tool ids, an `ensureEnv` cycle.
- **Wrong by construction.** "Welford accumulators" across four files
where the code keeps naive `n`/`sum`/`sumSq`; `sum`/`sumSq` documented
over `actualDuration` when reduce sums `selfDuration`; a strict-mode
halving written `n/2` where the code ceils; field docs listing enum
values the producers never emit.
- **Guarantees the code does not make.** A validation matrix claiming to
cover "EVERY tool" that skips flagless ones; a Pareto cutoff that
`slice(0, 20)` makes inert; an idempotence claim where the real rule is
at-or-ahead; a capability note describing a clean 400 the shape-based
device resolver can never produce.
- **Unverifiable assertions** about prebuilt binaries, external CLIs and
the cloud SDK — deleted rather than kept as folklore, since nothing in
the repo can confirm them.
- **Stale numbers**: invented Android tool versions, hard-coded tool
counts and description lengths that had drifted.
## Review
A Fable agent reviewed both halves adversarially for over-deletion,
misread code, `no-empty` hazards and byte-identity violations.
Second-half verdict: **SHIP**, with two one-line restores, both applied
in the final commit — the `npm view ""` rationale behind a blank-token
guard, and the note that `argent-mcp` keeps a copy of
`SECRET_PLACEHOLDER_MARKER` it cannot import.
## Code issues surfaced but deliberately not fixed
This pass changes comments only. Eight genuine findings are logged for a
follow-up:
1. `telemetry/src/consent.ts` — a non-ENOENT read error returns null and
falls through to the default-on path, so file errors *can* silently flip
telemetry on.
2. `chromium-server/navigation.ts` — `navigate()` is reachable from
`POST /api/navigate` with only a `typeof === "string"` check; open-url's
schema is a bare `z.string()`, so the "already validated by zod" premise
never held.
3. `http.ts` — `constantTimeEqual` returns early on a length mismatch,
so the auth token's length is observable.
4. `describe/index.ts:~114` — the ios-remote branch passes `{ isTvOs:
false }` unconditionally, so a remote tvOS simulator takes the iOS
ax-service path, though `isRemoteTvOsSimulator` exists and shake/paste
do use it.
5. `devices/boot-device.ts` — `-crash-report-mode never` is passed
unconditionally *and* appended again by the feature-detecting path, so
every emulator spawn passes it twice.
6. `react-profiler/pipeline/04-rank.ts` — `PARETO_THRESHOLD_PCT` is
dead: `slice(0, 20)` always wins.
7. `reaped-sessions.ts` — a user-facing hint string tells the agent that
`react-profiler-start { force: true }` disposes the debugger and
profiler session; it does not. Left byte-identical because it is a
string literal, not a comment.
8. `utils/simctl-backend.ts` — `localSimctl` is exported with no
importers anywhere.
## Docs
No documentation change is needed: this pass touches only source
comments, and no user-facing capability, tool, CLI flag, config key or
flow-file behaviour changed.
---------
Co-authored-by: filip131311 <f.kaminski2000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
130 lines
4.6 KiB
JavaScript
130 lines
4.6 KiB
JavaScript
// End-to-end smoke for Argent's Chromium (CDP) control plane, driving the running
|
|
// tool-server over HTTP exactly as an MCP client would. Chromium control is pure
|
|
// host-side TypeScript + CDP — the Rust simulator-server is not involved — so a
|
|
// hosted Windows runner with no virtualization verifies it fully. Also runnable on
|
|
// macOS/Linux for local debugging.
|
|
|
|
import { mkdirSync, copyFileSync, statSync, existsSync } from "node:fs";
|
|
import { tmpdir } from "node:os";
|
|
import { join } from "node:path";
|
|
|
|
const BASE = process.env.ARGENT_E2E_URL ?? "http://127.0.0.1:3033";
|
|
const OUT = process.env.ARGENT_E2E_OUT ?? tmpdir();
|
|
mkdirSync(OUT, { recursive: true });
|
|
|
|
const sleep = (ms) => new Promise((r) => setTimeout(r, ms));
|
|
|
|
function fail(msg, extra) {
|
|
console.error(`\n❌ E2E FAILED: ${msg}`);
|
|
if (extra !== undefined)
|
|
console.error(typeof extra === "string" ? extra : JSON.stringify(extra, null, 2));
|
|
process.exit(1);
|
|
}
|
|
|
|
async function callTool(name, body = {}) {
|
|
const res = await fetch(`${BASE}/tools/${name}`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify(body),
|
|
});
|
|
const text = await res.text();
|
|
let json;
|
|
try {
|
|
json = JSON.parse(text);
|
|
} catch {
|
|
throw new Error(`${name}: non-JSON response (${res.status}): ${text.slice(0, 300)}`);
|
|
}
|
|
if (!res.ok || json.error) {
|
|
throw new Error(
|
|
`${name}: HTTP ${res.status} ${json.error ? `- ${json.error}` : text.slice(0, 300)}`
|
|
);
|
|
}
|
|
return json.data ?? json;
|
|
}
|
|
|
|
async function waitForServer() {
|
|
for (let i = 0; i < 60; i++) {
|
|
try {
|
|
const res = await fetch(`${BASE}/tools`);
|
|
if (res.ok) {
|
|
console.log(`✓ tool-server up at ${BASE} (t+${i}s)`);
|
|
return;
|
|
}
|
|
} catch {
|
|
// not up yet
|
|
}
|
|
await sleep(1000);
|
|
}
|
|
fail(`tool-server never responded at ${BASE}/tools within 60s`);
|
|
}
|
|
|
|
async function main() {
|
|
await waitForServer();
|
|
|
|
// 1) list-devices discovers Chromium by probing CDP ports.
|
|
const devices = await callTool("list-devices");
|
|
const list = devices.devices ?? [];
|
|
console.log(
|
|
`list-devices → ${list.length} device(s): ${list.map((d) => `${d.platform}:${d.id ?? d.udid ?? d.serial}`).join(", ") || "(none)"}`
|
|
);
|
|
const chromium = list.find((d) => d.platform === "chromium");
|
|
if (!chromium)
|
|
fail(
|
|
"no chromium device discovered — is Chrome running with --remote-debugging-port?",
|
|
devices
|
|
);
|
|
const udid = chromium.id;
|
|
console.log(`✓ discovered chromium device: ${udid}`);
|
|
|
|
// 2) Screenshot must return real pixels.
|
|
const shot = await callTool("screenshot", { udid });
|
|
const hostPath = shot?.image?.hostPath;
|
|
if (!hostPath || !existsSync(hostPath)) fail("screenshot returned no readable hostPath", shot);
|
|
const size = statSync(hostPath).size;
|
|
console.log(`✓ screenshot: ${hostPath} (${size} bytes)`);
|
|
if (size < 1000) fail(`screenshot suspiciously small (${size} bytes) — likely a blank frame`);
|
|
copyFileSync(hostPath, join(OUT, "chromium-before.png"));
|
|
|
|
// 3) describe surfaces the DOM.
|
|
const before = await callTool("describe", { udid });
|
|
const beforeText =
|
|
typeof before === "string" ? before : (before.description ?? JSON.stringify(before));
|
|
if (!/ArgentTapTarget/i.test(beforeText)) {
|
|
fail(
|
|
"describe did not surface the page's tap target (ArgentTapTarget)",
|
|
beforeText.slice(0, 800)
|
|
);
|
|
}
|
|
console.log("✓ describe surfaced the DOM (found ArgentTapTarget)");
|
|
|
|
// 4) gesture-tap dispatches a real click.
|
|
const tap = await callTool("gesture-tap", { udid, x: 0.5, y: 0.5 });
|
|
if (!(tap?.tapped === true)) fail("gesture-tap did not report tapped:true", tap);
|
|
console.log("✓ gesture-tap reported tapped:true");
|
|
|
|
// 5) e2e-chromium-page.html's click handler rewrites the button to TAPPED-OK.
|
|
let observed = false;
|
|
for (let i = 0; i < 10; i++) {
|
|
const after = await callTool("describe", { udid });
|
|
const afterText =
|
|
typeof after === "string" ? after : (after.description ?? JSON.stringify(after));
|
|
if (/TAPPED-OK/i.test(afterText)) {
|
|
observed = true;
|
|
break;
|
|
}
|
|
await sleep(500);
|
|
}
|
|
const finalShot = await callTool("screenshot", { udid });
|
|
if (finalShot?.image?.hostPath && existsSync(finalShot.image.hostPath)) {
|
|
copyFileSync(finalShot.image.hostPath, join(OUT, "chromium-after.png"));
|
|
}
|
|
if (!observed) fail("tap did not mutate the DOM (TAPPED-OK never appeared in describe)");
|
|
console.log("✓ tap mutated the DOM (TAPPED-OK observed) — real interaction confirmed");
|
|
|
|
console.log(
|
|
"\n✅ Chromium E2E passed on this host — discover, screenshot, describe, and tap all work."
|
|
);
|
|
}
|
|
|
|
main().catch((err) => fail(err.message ?? String(err), err.stack));
|