Commit Graph

1710 Commits

Author SHA1 Message Date
Dragan Spiridonov 4a3b96d112 chore(release): bump version to v3.11.2 2026-06-27 11:36:40 +00:00
Dragan Spiridonov 9fd18ed00a feat(code-intelligence): first-class C4 architecture diagrams (ADR-112)
Consolidate C4 diagram generation onto a single engine and expose it to
users via CLI and MCP, with a deterministic confidence gate and real
Knowledge-Graph-derived relationships.

- Consolidation (C1/C6): C4ModelService is the single render/analyze/store
  engine; the bridge delegates and FAILS LOUD on a render error instead of
  silently degrading. Duplicate inline generators removed.
- C2: real component relationships from the Knowledge Graph (AST import/call
  edges) replace the naming heuristic; project-scoped via a new KG basePath
  so repos outside cwd don't trip the path-traversal guard.
- C3: deterministic confidence gate (high/medium/low + reasons) on every
  diagram — surfaces the detector's known limits instead of hiding them.
- C4/C5: `aqe code c4` CLI + `qe/code/c4` MCP tool (generate/search),
  verified at MCP-CLI parity and through the protocol-server bridge.
- Search: generate persists embeddings (opt-in `enableC4Embeddings`, on for
  MCP) so `qe/code/c4 search` returns hits in the standard flow.
- Fixed pre-existing lint in touched files (require->import, unused catches).

Docs: ADR-112 + docs/guides/c4-architecture-diagrams.md. tsc + lint clean;
C4 surface fully green.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-27 11:27:25 +00:00
Dragan Spiridonov 408e07e3a8 Darwin-for-QE — Cost Reduction & Plain-English Results 2026-06-26 16:48:21 +00:00
Dragan Spiridonov bd2d1736f6 docs(learning): add memory.db Data Model section to ReasoningBank guide
Document the qe_patterns table (5 column groups, dedup index, score
formulas) and all connected tables: FK-bound satellites (embeddings,
nulls, versions, evolution, relationships), convention-linked tables
(usage ledger, deltas, FTS), outcome/feedback tables (experiences,
applications, trajectories, routing_outcomes, rl_q_values), and the
shared backbone (kv_store task-bridge, vectors, dream, concept graph).
Grounded in the live schema v10. Includes relationship diagram.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 10:22:46 +00:00
Dragan Spiridonov 3fd38c09d5 docs(learning): fill gaps in ReasoningBank guide — nulls, CLI, routing confidence, free-tier
- Add "Learning From Failure — Kept Nulls" section (ADR-110): negative
  pattern records, context fingerprints, retrieval-time discount
- Add "Inspecting & Steering — CLI Commands": aqe learning / aqe memory
- Add "Understanding the Numbers": explain session-start routing
  confidence / success rate and why confidence climbs with use
- Add "Cheap-Local Self-Improvement" (ADR-111, opt-in escalation ladder)
- Fix stale v3/src/ paths → src/; add nulls/free-tier/CLI files to table

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 10:01:52 +00:00
Dragan Spiridonov c092dce5e9 Merge pull request #546 from proffesor-for-testing/working-june
chore(release): v3.11.1
v3.11.1
2026-06-25 12:36:49 +02:00
Dragan Spiridonov 38cdaead93 fix(ci): degraded-mode drill must not omit the test-runner's native deps
The absent-drill ran `npm ci --omit=optional` then vitest — but vitest's bundler
(rolldown) has its OWN native binary in optionalDependencies, so a blanket
--omit=optional removed it and the test runner crashed (MODULE_NOT_FOUND for
rolldown-binding) before testing anything. There's no selective omit.

Fix: install + build normally, then simulate ONLY the APP's native optionals
absent (rm @ruvector/* + hnswlib-node + rvlite), and prove the degraded path with
a PURE-NODE smoke (no test runner): the CLI boots and loadOptionalModule degrades
on a genuinely-absent app native while still loading present modules. Version read
from package.json (no hardcode). App code unchanged — this was a workflow flaw.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 09:58:39 +00:00
Dragan Spiridonov e25a1ef95e chore(release): bump version to v3.11.1 2026-06-25 08:25:02 +00:00
Dragan Spiridonov a42c3073e0 feat(shared): graceful optional-module loading + CI absent-drill (plan 05 / A9)
ADR-150 graceful-degradation core. AQE's native/optional deps (@ruvector/*,
hnswlib-node, rvlite) must degrade — not crash — when a platform binary or a
Dependabot-pruned lockfile is missing.

- src/shared/optional-module.ts: loadOptionalModule(name, req?) → {available}|
  {degraded}. Fixes the #528 anti-pattern in the existing ad-hoc
  try{require}catch{} (6+ ruvector wrappers): degrades ONLY on genuine absence
  (MODULE_NOT_FOUND) and RE-THROWS real load failures (ABI mismatch / corrupt
  .node) instead of masking them. 8 tests incl. the rethrow property.
- .github/workflows/degraded-mode.yml: the absent drill — npm ci --omit=optional
  --ignore-scripts, then run the degraded-path tests. Pairs with the regular
  install job (proves both paths, #528).

Follow-up (held, CI-verified): migrate the ad-hoc sites + the static import in
sona-wrapper.ts onto loadOptionalModule (changes a production native-load path).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 07:59:04 +00:00
Dragan Spiridonov 82dfa013ef chore(darwin): A8 version contract — pin ScoreCard compat, hold the dep-swap
Investigated A8 (pin @metaharness/darwin + retire the type-mirror):
- VERIFIED: AQE's DarwinScoreCard mirror is byte-identical to upstream ScoreCard
  from @metaharness/darwin@0.2.1 THROUGH the published 0.7.0 (no drift, 5 minors).
- HELD the dep-swap deliberately: upstream is fast-moving pre-1.0 with napi/wasm
  transitive deps; adding it changes every user's install + lockfile and can't be
  verified locally (host-shared-node_modules breaks native rebuilds) — negative-EV
  vs 74 stable, zero-coupling mirror lines.
- SHIPPED the version-contract half: pinned provenance (0.2.1–0.7.0) + a drift-
  guard test (darwin-version-contract.test.ts) that fails CI on any field-set
  divergence. 17 darwin tests green; tsc clean.

Swap only after upstream stabilizes (≥1.0) + a CI-verified install impact; needs OK.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 07:30:43 +00:00
Dragan Spiridonov a384a640bb feat(audit): witnessed finding delivery (A7) + user-facing Darwin-QE guide
A7 (AQE side): point the Ed25519 witness chain at DELIVERED findings, not just
internal events.
- witness-chain: add FINDING_DELIVERED / FINDING_BLOCKED action types.
- witness-findings.ts: recordDeliveredFindings / recordGateResult bridge
  adversarial-verify verdicts → the tamper-evident chain; verifyDeliveryChain
  FAILS CLOSED (throws on tamper / signature failure) — no silent {valid:true}.
  Kept AQE-side (the @ruvector/adversarial-verify package stays host-agnostic).
- 4 tests (in-memory DB): delivered chain verifies, gate result split, tamper →
  throws, Ed25519 sign+verify round-trip. tsc clean.
- MetaHarness-side JS verifier contribution is cross-repo (separate, needs OK).

Docs: docs/guides/darwin-qe-self-learning.md — user-facing guide (benchmarks,
learnings, what shipped, how to enable + configure the cheap-first/cross-model
self-learning lane).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 07:28:01 +00:00
Dragan Spiridonov c347662f63 feat(routing): cost-Pareto Value Score + measured QE economics (plan 05 / A13)
Operationalize ADR-111's "competitive cheaper than frontier" / Ruv's ADR-179
quality-per-$ leaderboard as pure router primitives:

- value-score.ts: valueScore(m,{costWeight}) tunable slider, rankByValue, and
  paretoFrontier (the non-dominated cost/quality set a router should choose from).
- MEASURED_QE_TEST_GEN: a dated D3/A12 economics snapshot (measured composite +
  per-instance cost) — NOT vendor claims (qwen3-coder rank didn't transfer). The
  measured frontier correctly drops qwen3:8b (below floor, dominated) and keeps
  qwen3:30b-a3b (free, floor-clearing) + sonnet (frontier).
- 8 tests; strict-tsc clean.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 07:21:27 +00:00
Dragan Spiridonov bac8604a79 feat(verification): verifyGate output gate (plan 05 / A5)
The opt-in "verify before you emit" primitive a vertical/harness embeds: route
findings through the blind refuters, drop the refuted, surface every verdict for
witness, report overhead. Built in @ruvector/adversarial-verify (vendor-ready,
zero deps) so MetaHarness can embed it.

- gate.ts: verifyGate(findings, {judge, enabled, dropUncertain}) →
  {emitted, blocked, all, latencyMs, judgeCalls}. Disabled ⇒ no-op, ZERO judge
  calls (cost-neutral). Default-off-able per cheap-vertical posture.
- gate.test.ts (6): (a) false claim killed (b) true survives (c) no-op cost-
  neutral when disabled (d) overhead measured. 31 green across the module; tsc clean.

MetaHarness-side embedding (template var + generated-harness wiring) is spec'd in
plan 05 — cross-repo (agent-harness-generator) + needs the package vendored/
published, both pending explicit OK.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 07:15:11 +00:00
Dragan Spiridonov 1960598c59 feat(verification): extract @ruvector/adversarial-verify (plan 05 / A2)
Factor AQE's blind-refuter primitive out of qcsd-development-review.js into a
host-agnostic, ZERO-AQE-dependency module (publishable as @ruvector/* later;
not published per no-publish-without-OK). Closes G2.

- src/verification/adversarial-verify/: types (Finding/FindingVerdict/Judge),
  blind refuterPrompt + lenses (ADR-074), pure k-of-n majority-kill synthesis,
  adversarialVerify orchestrator (injected Judge — no agent()/Claude dep),
  calibrate() (false-kill/false-keep vs ground truth, any Judge).
- 25 tests: synthesis math, blind orchestration, calibration (majority-of-3 ≤
  single-refuter error), and PARITY — byte-identical to the workflow's inline
  synthesis. The Workflow harness sandboxes .claude/workflows (no imports), so
  the workflow inline-mirrors the package; annotated canonical + parity-guarded.
- Verification (plan A2): (a) synthesis tests ✓ (b) calibration mechanism ✓
  (c) regression parity ✓ (d) zero AQE import (grep) ✓. strict-tsc clean.

Remaining (optional): empirical real-LLM false-kill on a labeled corpus (inject
a real local/OpenRouter Judge into calibrate()). Unblocks A5.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 07:07:14 +00:00
Dragan Spiridonov e44503e389 feat(routing): cross-model best-of-k in the free-tier executor (A12, opt-in)
A12 measured cross-model best-of-N at +6 composite over single-model (diverse
models cover each other's validity failures; the win is captured by first-pass
selection, no judge needed). Wire it as an opt-in capability:

- executor: candidateProviders?: FreeTierProviderConfig[] — when set, round-0
  best-of-k at the START free tier draws each candidate from a DIFFERENT provider
  (e.g. local qwen + an OpenRouter model) instead of one model's variants;
  selection stays the objective verifier (first-pass = validity rescue). Per-
  candidate attempt.model telemetry. Off (single-model) unless set.
- coordinator-support: FreeTierCoordinatorConfig.freeTierCandidateProviders
  passthrough so coordinators can opt in.
- tests: cross-model rescue (falls through to the valid model, no escalation) +
  single-model-unchanged. 87 green across the lane; strict-tsc clean.

No judge wired — A12 showed it does not beat first-valid on the cross-model pool.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-25 06:55:38 +00:00
Dragan Spiridonov 2ce12df382 bench(A12): cross-model best-of-N is the WIN — +6 composite, judge not needed
Measured n=20 (qwen3:30b local + glm-5.2 OpenRouter, judge deepseek-v3.2):
- Cross-model best 84.8 vs qwen-alone 63.5 / glm-alone 71.2; the two models cover
  each other's validity failures (qwen 0-valid on 4 instances, glm on 3, both on 11).
- Selector delivery (14 judged): judge 82.8 vs first-valid 82.2 (Δ0.6, noise) vs
  qwen-alone 76.1 → cross-model gives +6 over single-model and barely needs the judge.
- A11 judge's same-model 88.9% did NOT transfer cross-model (33% best-pick).
- Production lever = cross-model GENERATION + cheap selection, NOT a judge.

Fixed a tautological metric: "union lift vs max(single models)" was always 0
(== cross-model best); now reports lift vs EACH model alone + validity rescue.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 17:19:42 +00:00
Dragan Spiridonov 5e42ea1696 docs(metaharness): correct A12 — executor escalation is ALREADY cold (not warm)
Code check of FreeTierEscalatingExecutor: each escalated tier's round-0 prompt is
built from req.messages (cold), not the prior tier's failed output (executor.ts:248-251).
The only warm context is within-tier repairMessages — correctly scoped. So the
plan's "executor escalates warm" claim was wrong; ADR-182 cold-start is already
satisfied. A12 reduces to the cross-model best-of-N lever (d3-xmodel.mjs, running).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 12:13:04 +00:00
Dragan Spiridonov 5d453682e5 feat(metaharness): A12 cross-model best-of-N harness (the A11 judge unlock)
A11 validated the judge (deepseek-v3.2 = 88.9%) but its aggregate gain was ~0
because a single model's candidates cluster. A12 generates candidates ACROSS
families to widen the spread so the judge can pay off.

- d3-xmodel.mjs: generators = local qwen3:30b-a3b + OpenRouter z-ai/glm-5.2
  (cross-family); judge = deepseek-v3.2 (a third family — clean writer≠evaluator).
  No Anthropic, per preference. Routes local↔OpenRouter by slug; scores every
  candidate by REAL mutation-kill+coverage (ground truth, judge blind).
- Measures: union lift (cross-model best vs best-single-model), per-model win
  share, and the judge's regret-vs-first-valid on the wider pool.
- Smoke (1 instance): GLM 82.5 > qwen 75.0; judge picked GLM → Δ +7.5 vs
  first-valid (vs A11's clustered ~0.5). Full n=20 run pending.

Model note: Qwable-3.6-27b (local, Qwen3.5 dense) is diverse but too slow
(9.3 tok/s) for the loop — OpenRouter cross-family generator used instead.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 12:11:13 +00:00
Dragan Spiridonov 99206a6640 docs(metaharness): A11 retry OVERTURNS the negative — judge validated (deepseek-v3.2 = 88.9%)
The v1 "judge does not beat first-valid" was a measurement artifact: candidate
code was truncated to 2500 chars and the judge was the cheapest model. Retry
(full code, multi-judge, n=30):

- deepseek-v4-flash: 71.4% -> 77.8% best-pick (truncation fix alone).
- deepseek-v3.2 (stronger): 88.9% (8/9 discriminating) — clears Ruv's 88% bar.

So the judge IS reliable. But aggregate regret gain over first-valid is only
~0.5 pts (within noise) because qwen's candidates cluster — the judge's payoff is
gated on candidate DIVERSITY, which is the empirical case for A12 (cross-model
best-of-N). A11 proved the judge works; A12 gives it spread to act on.

- d3-judge.mjs: multi-judge (D3_JUDGE_MODELS), full candidate code, per-judge
  3-way verdict; last-number parse for reasoning judges.
- plan 05: A11 corrected to VALIDATED-but-spread-gated; forward plan -> A12.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 11:01:05 +00:00
Dragan Spiridonov 8220c0aad3 docs(metaharness): A11 judge discriminator — measured NEGATIVE, not wired (ADR-183 discipline)
Precision-validated the writer≠evaluator LLM-judge selector against AQE's
mutation-kill ground truth (writer=local qwen3:30b, judge=OpenRouter
deepseek-v4-flash — no Anthropic, per preference).

Result (n=20, 7 discriminating): judge picks best 71.4% (< Ruv's 88% bar);
composite regret judge 2.1 vs first-valid 1.9 vs random 2.0 = within noise.
Verdict: do NOT wire the judge — qwen's QE-test candidates cluster, so first-valid
is already near-optimal and a cheap judge adds no measurable lift. Could flip with
a stronger judge or wider candidate spread (A12 cross-model best-of-N).

- d3-judge.mjs: honest 3-way verdict (INCONCLUSIVE within noise vs WIN/LOSE).
- plan 05: A11 status + forward plan (A1 done, A11 negative, A12 next).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 08:09:43 +00:00
Dragan Spiridonov 41bfa05bee docs(metaharness): ADR-111 + D3 fixture-diverse gate + plan-05 reconciliation + A11 judge harness
- ADR-111 (Accepted, scoped to the escalation lane): cheap-replaces-frontier = G-ABORT;
  the asymmetric escalation lane is the committed product.
- D3 gate harness now corpus-driven (docs/metaharness/prototype/d3-corpus/: pricing,
  strings, stats, validate, timefmt). Fixture-diverse n=30 confirmation: §12 best-of-k
  and §11 coder-binds hold 5/5 modules; escalation lane ≈ frontier within composite SE.
- d3-judge.mjs: A11 writer≠evaluator LLM-judge discriminator precision-validation
  (writer=local qwen3:30b, judge=OpenRouter deepseek-v4-flash, no Anthropic), per ADR-183.
- docs 06: D3 progression + honesty caveats (adversarial review); 00: exec-summary brought
  current; 05: status reconciliation (A1 done, A6 retired, A3 resolved) + oracle-arc
  actions A11-A13 from Ruv's ADR-178/182/183/184.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 07:43:03 +00:00
Dragan Spiridonov f417d03be1 feat(routing): best-of-k + Goodhart guard + broaden free-tier lane (ADR-111)
Implements the asymmetric escalation lane corrections measured in D3 and makes
the opt-in reusable beyond test generation. All opt-in, off by default.

- executor: bestOfK diverse attempts per tier (§12 — single gated shots Goodhart,
  best-of-k converts); oracleKind 'objective'|'self-authored' Goodhart guard (§10 —
  a self-authored gate is withheld from routing-feedback so it can't lift confidence).
- coordinator-support: reusable buildFreeTierExecutor factory + runFreeTierTextTask;
  default cheap model raised qwen3:8b -> qwen3:30b-a3b (D3: 8B below the gen floor).
- test-generation: refactored onto the factory; bestOfK=2 (the D3-validated config,
  was running single-shot).
- requirements-validation: second adopter — opt-in cheap-first BDD/Gherkin gen with a
  strengthened relevance oracle (rejects off-topic boilerplate, resists §10) + D9 sink.
- tests: executor (best-of-k, guard), coordinator-support factory, requirements opt-in
  (incl. anti-Goodhart + D9). Full free-tier+coordinator sweep green; strict-tsc clean.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 07:42:43 +00:00
Dragan Spiridonov c0cfc16d27 feat(mcp): default-deny MCP policy gate — plan 05 / A1 (G1)
Closes G1 of the cross-pollination plan: AQE now governs its own ~90-tool
MCP surface with a default-deny policy + CI gate ("npm audit for agent tools").

- .harness/mcp-policy.json: truthful default-deny snapshot; _enforcement labels
  what is wired (tool-scoping default-deny, witness-chain audit) vs posture/
  stated-intent — not theater.
- scripts/mcp-policy-gate.mjs: self-contained mirror of MetaHarness mcp-scan's
  HIGH checks; also reads .mcp.json (closing the scan false-negative where AQE's
  server is declared there, not in .claude/settings.json). Exit 1 on any HIGH.
- .github/workflows/mcp-policy-gate.yml + `npm run security:mcp-policy`.
- tool-scoping: fix the interface doc-comment that claimed "empty/undefined ->
  allowAll" (the code DENIES by default); export ALL_AGENT_ROLES.
- tests/unit/mcp/mcp-policy-gate.test.ts: drift guard (policy roles <-> enforcement),
  default-deny posture. 46/46 green; scan = 0 HIGH; fails-closed verified.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 07:42:27 +00:00
Dragan Spiridonov 12b9be62ca ruflo 3.14.0 init 2026-06-23 07:26:03 +00:00
Dragan Spiridonov 06fe3ea49e Merge branch 'main' into working-may 2026-06-23 07:03:32 +00:00
Dragan Spiridonov 28673bc18b Merge pull request #544 from proffesor-for-testing/feat/darwin-qe-self-learning
chore(release): v3.11.0
v3.11.0
2026-06-20 16:10:42 +02:00
Dragan Spiridonov 5a07f5272a docs(release): include PACT→PACTS (#545) in v3.11.0 release notes
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 14:09:23 +00:00
Dragan Spiridonov db515750e6 Merge remote-tracking branch 'origin/main' into feat/darwin-qe-self-learning 2026-06-20 14:08:17 +00:00
Dragan Spiridonov dba4a14a0d Merge pull request #545 from proffesor-for-testing/pacts-migration
Migrate PACT → PACTS framework (add Structured principle)
2026-06-20 16:08:05 +02:00
Dragan Spiridonov 11f0cf755f Migrate PACT → PACTS framework (add Structured principle)
Evolve the QE framework from PACT (Proactive, Autonomous, Collaborative,
Targeted) to PACTS by adding a fifth principle: Structured — governance,
observability, and explainability of agent behavior. We measure confidence,
not trust (trust is a human feeling; confidence can be mathematically
explained). Especially important in regulated industries. Inspired by DORA's
research on AI-assisted delivery and platform-engineering quality measurement.
Anti-pattern: bolting agentic AI onto chaos.

Scope:
- Source skills (.claude/skills): holistic-testing-pact + agentic-quality-
  engineering SKILL.md, agentic-quality-engineering schema (added optional
  `structured` dimension, kept slug keys), README, skills-manifest.json
- Regenerated derived artifacts: assets/skills (via prepare-assets equivalent
  copy) and the two affected .opencode yaml (via generate-opencode-skills)
- Hand-maintained trees updated consistently: .kiro skills, docs (catalog,
  glossary, intro), plugin/marketplace manifests, qe-learning-coordinator

Stability:
- Kept skill id/dir `holistic-testing-pact` (and `.kiro` `qe-holistic-testing-pact`)
  unchanged — referenced across other repos. Only titles/descriptions/content
  changed to PACTS.

Attribution: PACT originated with Reuven Cohen (Agentics Foundation); adapted
to QE by Dragan Spiridonov. PACTS adds Structured.

Co-Authored-By: claude-flow & Agentic QE fleet
2026-06-20 15:35:56 +02:00
Dragan Spiridonov 440d7fab99 chore(release): bump version to v3.11.0
Free-tier local test generation (opt-in) — cheap-first on local/free models
with a repair loop, auto-escalation to paid tiers, and self-learning routing
feedback. Plus #541 dependency fixes (ruvllm optional deps + hono security).

Version synced across all product manifests: package.json, fleetVersion in
both .claude/ and assets/ skills-manifests, and .claude-plugin/plugin.json
(the latter two had drifted at 3.10.4).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 13:10:20 +00:00
Dragan Spiridonov a11f4480eb Merge remote-tracking branch 'origin/main' into feat/darwin-qe-self-learning 2026-06-20 13:00:03 +00:00
Dragan Spiridonov f51f09581d Merge pull request #541 from proffesor-for-testing/dependabot/npm_and_yarn/npm_and_yarn-c3b932bfa0
chore(deps-dev): bump hono from 4.12.23 to 4.12.25 in the npm_and_yarn group across 1 directory
2026-06-20 14:57:39 +02:00
Dragan Spiridonov 318d988060 fix(test-gen): audit fixes — multi-file fallback + missing package export
Self-audit of the free-tier lane found two gaps:

- Multi-file: the free-tier path generated for sourceFiles[0] only, silently
  skipping the rest AND the paid path. Now it engages only for single-file
  requests; multi-file falls back to the normal path so every file is covered.
  (+1 regression test.)
- Exports/docs mismatch: the guide + README showed
  `import ... from 'agentic-qe/routing/free-tier'`, but package.json had no
  ./routing export — the import would fail for npm consumers. Added the
  ./routing/free-tier subpath export.

Verified: project `tsc --noEmit` clean; 236 routing/coordinator/plugin tests +
18 routing-feedback tests green; no sibling breakage from the generic tracker.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 12:55:07 +00:00
Dragan Spiridonov 4409699a2b feat(test-gen): enable paid escalation + wire D9 routing-feedback at kernel layer
Completes the cheap-first economics: local → repair → escalate the hard tail.

- coordinator: build a claudeRunner from the existing HybridRouter (tier →
  complexity hint) and run the free-tier path with escalate:true. Falls back to
  local-only automatically when no router is wired. patternsUsed now records the
  winning tier.
- plugin (kernel layer): onInitialize constructs a live RoutingFeedbackCollector
  (EMA calibration + auto-escalation, memory-only fallback) when the free tier is
  opted in, and injects it as the coordinator's routingFeedback sink — so each
  cheap-vs-escalated outcome drives the calibrator/escalation tracker/confidence
  (lifts the stuck-at-40% routing metric). Built only when opted in.
- tests: +2 (escalation via router, D9 sink invocation); 113 green; existing
  coordinator (47) and plugin (38) suites unchanged. Type-safe (MessageRole /
  TaskComplexity / RoutingConfig fields all confirmed).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 12:43:22 +00:00
Dragan Spiridonov b26edbf5e6 feat(test-gen): opt-in free local-tier generation + repair loop (D7-wire/D8/D9)
Apply the free-tier escalation work to the test-generation coordinator as an
OPT-IN, default-off capability (Ruv's cheap-first economics). Zero impact unless
enabled via `enableFreeTier` config or `AQE_FREE_TIER=1`.

- coordinator: guarded `tryFreeTierGeneration()` tries the free local model first
  (reads source, prompts, verifies test+assertion), falls through to the
  unchanged paid path on any miss. 47 existing coordinator tests still green.
  New optional `routingFeedback?` ctor param wires D9.
- D8 repair loop: executor gains same-tier repair (`repairAttempts`, verifier
  feedback fed back) + `escalate:false` repair-only mode. Coordinator path runs
  local-only + repair, no paid escalation yet.
- D9 sink: createRoutingFeedbackSink() maps executor outcomes onto the existing
  RoutingFeedbackCollector (calibrator + escalation + confidence); cheap wins
  raise the cheap tier's confidence, lifting the stuck-at-40% routing metric.
- docs: user guide docs/guides/free-tier-local-models.md (local/cloud Ollama,
  OpenRouter, OpenAI-compatible) linked from README.
- tests: +11 new (executor repair, sink, coordinator opt-in); 111 green total;
  free-tier modules strict-tsc clean.

Model: qwen3:8b default. Keys read from named env vars, never stored.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 12:31:44 +00:00
Dragan Spiridonov 7155d8234b feat(routing): D7-wire — FreeTierEscalatingExecutor (cheap-first, verify, escalate)
Turns the dormant free-tier ladder into a running loop implementing Ruv's
SWE-bench economics for a QE task: run on the cheap local tier, verify with an
objective oracle, escalate this task up the ladder on failure, and record the
start-tier verdict so the base tier adapts across tasks.

- executor.ts: decoupled by injection — free tiers via freeTierChat, Claude
  tiers via an injected ClaudeTierRunner (no Anthropic SDK dep; coordinator
  delegates to its existing HybridRouter). Local-only mode when no runner.
  onOutcome sink = the D9 seam into routing-feedback.
- tests: 8 new (53/53 green across free-tier + tracker), strict-tsc clean.
- prototype/d7-wire-proof.mjs: LIVE — qwen3:8b generated a correct vitest test
  that passed the objective verifier in 8.65s ($0, no escalation); an
  impossible verify climbed local->haiku->sonnet->opus and failed at the top.

Model: qwen3:8b (most productive worker in D0; 5.2GB fits the 8GB story).
Additive only — no shipped coordinator hot-path edited. Adoption is a one-call
snippet documented in docs/metaharness/06 (behind a flag; needs sign-off).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 11:16:48 +00:00
Dragan Spiridonov 0d1a846dbe feat(routing): D7 — free local tier in the escalation ladder
Ruv's SWE-bench Round-3 economics for AQE: cheap-local handles the bulk,
escalate only failures up the existing Claude tiers. Maps onto AQE's
existing AutoEscalationTracker, which previously bottomed out at haiku (paid).

- escalation/auto-escalation-tracker.ts: made generic over the tier-name type
  with a configurable tierOrder (default resolved in ctor — DEFAULT_ESCALATION_
  CONFIG unchanged, so the exact-match test stays green). 26/26 original tests
  pass; zero behaviour change for existing callers.
- routing/free-tier/: configurable provider layer — local-ollama / cloud-ollama
  / openrouter / openai-compatible. Keys read from a named ENV VAR, never
  stored. freeTierChat() is OpenAI-compatible + reasoning-model aware + never
  throws (transport error = tier failure → escalate). defaultFreeTierLadder()
  = local -> haiku -> sonnet -> opus.
- tests: 19 new (45/45 green with the tracker suite), strict-tsc clean.
- prototype/d7-proof.mjs: live proof vs M5 host Ollama — free local tier
  answers ($0), escalates local->opus on failures, de-escalates back to local.

Dormant by design: not yet wired into a coordinator (next: D7-wire + D8 repair
loop + D9 feed outcomes into routing-feedback).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 09:31:39 +00:00
Dragan Spiridonov 3e43e8d155 feat(metaharness): Darwin-for-QE self-learning lane (A1 scan + D0/D1/D6)
Cross-pollination with Ruv's MetaHarness Darwin Mode: evolve the harness
around a frozen cheap local model, graded by AQE's objective QE metrics.

- docs/metaharness/06-...: GOAP action lane + ADR-style decision (→ ADR-111)
- A1: real mcp-scan snapshot of AQE's MCP surface (.harness/mcp-policy.json
  mirror) → 2 HIGH (default-deny OFF, shell granted), 6 MED, 2 LOW
- D0: local-mutator spike benchmark on host M5 Ollama (qwen3:8b/30b > gemma4
  as mutator; mock+LLM gives no fitness signal — documented)
- D1: src/integrations/darwin — QE→Darwin ScoreCard adapter folding ADR-104
  arena metrics (kill-rate/coverage/cost) + ADR-072 promotion-gate mirror
  (15/15 tests green, strict-tsc clean, zero coupling to @metaharness/darwin)
- D6: prototyped + proved a `customScore` hook in Darwin's evolve loop
  (patch in prototype/, Ruv's tree left pristine). QE-native scoring now
  DIFFERENTIATES variants: winner +0.1230 over baseline, 3 promotions
  (vs flat 0.765 from the mock substrate)

Two upstream PRs to ruvnet/agent-harness-generator are staged but unsent:
the customScore hook + --ruvllm-timeout/max-tokens CLI flags.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-20 07:40:05 +00:00
Dragan Spiridonov 0c41f9d60f fix(deps): restore @ruvector/ruvllm-* optional platform deps dropped by Dependabot
Dependabot's hono 4.12.23→4.12.25 bump (#541) regenerated the lockfile
and pruned the 5 optional @ruvector/ruvllm-* native platform packages
(darwin-arm64/x64, linux-arm64/x64-gnu, win32-x64-msvc), which breaks
`npm ci` (EUSAGE) for consumers — the same class of failure as #540.

This lockfile = main's lockfile with ONLY hono bumped to 4.12.25
(registry-verified integrity), optional platform deps preserved.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-19 15:52:20 +00:00
Dragan Spiridonov e664f3ec45 fix(ci): download dist artifact before integration tests on tag SHA
The v3.10.9 publish failed: the "Integration tests on tag SHA" job runs
test:integration:fast (which now includes the #528/#535 MCP integration tests
that drive the BUILT bundles), but the job never downloaded the dist artifact
from the build job. With CI=true the tests' guard refuses to silently skip, so
they hard-failed on a missing bundle. Add the download-artifact step (like the
init-gate and consumer-audit jobs already do) so the bundles are present.

No source/package change — re-releasing v3.10.9 (never published to npm).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
v3.10.9
2026-06-17 16:42:39 +00:00
Dragan Spiridonov 297f8bc55b Merge pull request #543 from proffesor-for-testing/fix/528-mcp-in-process
chore(release): v3.10.9
2026-06-17 18:29:46 +02:00
Dragan Spiridonov 7d3e977b75 chore(release): bump version to v3.10.9
MCP server reliability + database-free completeness (community issues from
@nagoodman): in-process `agentic-qe mcp` (#528), memory_delete stale-cache fix
(#535), db-free propagation to all editor MCP configs (#533), and the opt-in
--no-claude exclusive install (#532). Plus the js-yaml dev bump (#540) and the
devil's-advocate follow-up fixes (routing/merge/startup + CI guard).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-17 16:07:13 +00:00
Dragan Spiridonov 8eb060b6e2 ci(mcp): make the MCP integration regression tests actually run (C3)
The #528 and #535 integration tests (tests/integration/mcp, gated on
describe.skipIf(!BUILT)) never executed in CI — a false green:
- the mcp-integration-tests job ran `npm ci` but no `npm run build`, so the
  dist bundles were absent and both tests silently skipped;
- the step was `continue-on-error: true`, so even a real failure passed;
- neither test was in the release gate's test:integration:fast list.

Fixes:
- mcp-tools-test.yml: add `npm run build` before test:mcp:integration and drop
  continue-on-error so the job is a real gate (the exit-124 hang tolerance
  stays for the known vitest-hang flake).
- both tests: skip only for LOCAL unbuilt checkouts (`!BUILT && !process.env.CI`)
  — in CI a missing build now fails loudly instead of skipping. Verified:
  CI=1 with the bundle removed fails the suite instead of reporting green.
- package.json: add both tests to test:integration:fast so they also run on the
  release gate (npm-publish.yml), which builds first.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-17 15:46:16 +00:00
Dragan Spiridonov 112fffc466 fix(init,mcp): --no-claude routing (C1), db-free continuedev merge (C2), startup exit (H3)
Devil's-advocate review of today's branch surfaced three real gaps:

C1 (init-handler.ts): bare `aqe init --no-claude` (no --with-<platform>, no
--no-database) fell through to runStandardInit and installed the FULL Claude
surface it was meant to suppress — `noClaude` was only honored inside the
modular path. Add `options.claude === false` to the modular routing guard.
Verified: `aqe init --no-claude --minimal` now writes no .claude/, .mcp.json,
or CLAUDE.md (and the empty-install warning fires).

C2 (continuedev-installer.ts): the mergeExistingYamlConfig branch (existing
`mcpServers:` + --overwrite) appended a hardcoded AQE_MEMORY_PATH entry,
ignoring memoryBackend — re-introducing the #533 db leak in db-free installs
over an existing Continue config. Honor memoryBackend on this path too. Adds a
regression test.

H3 (entry.ts): main() ran fire-and-forget, so a startup rejection that escaped
its internal try hit the unhandledRejection handler (which intentionally keeps
the server alive at runtime) → on the in-process `agentic-qe mcp` path the CLI
wrapper would hang on its never-resolving promise with a zero exit. main() now
`.catch`es and exits non-zero on a failed startup. Re-verified #528/#535
integration tests still green (normal startup unaffected).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-17 15:42:24 +00:00
Dragan Spiridonov 5975171fe5 feat(init): db-free MCP propagation (#533) + --no-claude exclusive mode (#532)
#533 — database-free mode now propagates AQE_MEMORY_BACKEND=memory to ALL
generated MCP-server configs, not just opencode.json. Previously `aqe init
--no-database` left .mcp.json (Claude Code) and every editor config pointed at
.agentic-qe/memory.db, so launching the server via any non-OpenCode client
recreated the db at runtime and defeated the db-free install.
- platform-config-generator.ts: generateMcpConfig(platformId, { memoryBackend })
  emits AQE_MEMORY_BACKEND=memory and drops AQE_MEMORY_PATH for JSON/TOML/YAML;
  covers the 8 shared-generator installers (cursor/cline/continuedev/kilocode/
  roocode/windsurf/codex/copilot).
- 08-mcp.ts (.mcp.json) and kiro-installer.ts: same db-free env; learning/workers
  not forced on in db-free mode (they persist to SQLite).
- 09-assets.ts threads memoryBackend into every platform installer.
Default (persistent) output is byte-for-byte unchanged.

#532 — new opt-in `--no-claude` suppresses the default Claude Code surface
(.claude/ skills+agents, .mcp.json, CLAUDE.md, governance, hooks) so
`--with-<platform>` flags become the only install targets — e.g. a clean
OpenCode-only install. Gated via shouldRun/run on phases 07-hooks, 08-mcp,
09-assets (core assets), 11-claude-md, 13-governance. Default install
(no flag) is unchanged; warns if --no-claude is passed with no platform.

Verified by real `aqe init` runs in temp dirs:
- `--no-database --with-codex --with-cursor`: .mcp.json/.cursor/.codex all emit
  AQE_MEMORY_BACKEND=memory; no memory.db created.
- `--no-claude --with-opencode --no-database`: .opencode present; .claude/,
  .mcp.json, CLAUDE.md all absent.
- default `--with-cursor`: full surface + persistent env intact (no regression).
Adds db-free + no-claude cases to platform-config-generator and mcp-phase tests;
all 406 init unit tests pass.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-17 14:07:13 +00:00
dependabot[bot] 3265c90426 chore(deps-dev): bump hono in the npm_and_yarn group across 1 directory
Bumps the npm_and_yarn group with 1 update in the / directory: [hono](https://github.com/honojs/hono).


Updates `hono` from 4.12.23 to 4.12.25
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.12.23...v4.12.25)

---
updated-dependencies:
- dependency-name: hono
  dependency-version: 4.12.25
  dependency-type: indirect
  dependency-group: npm_and_yarn
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-06-17 13:57:01 +00:00
Dragan Spiridonov 7e224ca632 fix(mcp): memory_delete no longer masked by stale session-cache read (#535)
memory_delete returned {deleted:true} but an immediate memory_retrieve still
returned the value (with an identical timestamp). Root cause was NOT the delete
— it works. memory_retrieve is isConcurrencySafe, so the Issue-#473 session
cache stored its result; memory_delete never invalidated it, so the follow-up
read served the stale cached "found" entry (the identical timestamp was the
cache fingerprint). Confirmed by reproduction: with AQE_SESSION_CACHE=off the
post-delete read already returned found:false.

Fix: mutating tools now invalidate their domain's cached reads. Adds
SessionOperationCache.invalidateDomain() (clears in-memory + persisted rows);
the protocol server calls it after any successful tool whose name ends in a
mutation verb (_store/_delete/_set/_share/_update/_remove/_clear/_promote/
_cleanup). Generalizes to other write/read pairs (e.g. cross_phase_store).

Verified end-to-end through the protocol server with the cache ENABLED:
store -> retrieve(found) -> delete -> retrieve(found:false). Adds
tests/integration/mcp/memory-delete-cache-invalidation.test.ts.

Note: the other findings in #535 (cross_phase_stats counter, GOAP
maxSteps/plan-lookup/activeAgents, test_generate_enhanced quality,
qe_coherence_consensus text) are separate root causes and remain open for
dedicated follow-up per the issue's own "split into its own issue" note.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-17 13:45:46 +00:00
Dragan Spiridonov c5bd908b78 docs(metaharness): update cross-pollination plan after MetaHarness pull + ADR-150
Records the 2026-06-17 evidence: ADR-038 (DRACO ceiling) is now Accepted
upstream → the A3 gate leans G-ABORT; MetaHarness v0.1.15 ships mcp-scan --json
+ scorecard, shrinking A1 to "consume, not build"; and two new standalone
candidate actions lifted from ADR-150 (A9 graceful-degradation, A10 KRR router).
Cross-links the ADR-150 spawnSync bug class to AQE #528.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-17 13:12:00 +00:00
Dragan Spiridonov 5ac4c7cba7 fix(mcp): run agentic-qe mcp server in-process, not via double-spawn (#528)
The `mcp` subcommand spawned `node dist/mcp/bundle.js` with stdio:'inherit'.
With a piped stdin (any programmatic MCP client), the grandchild received
`stdin-eof` right after answering `initialize` and the Issue #513 stdin-EOF
guard shut it down before serving `tools/list` — so `tools/list` never
returned. The dedicated `aqe-mcp` bin (which runs the bundle directly) worked.

Fix: dynamic-import the MCP entry so it runs in-process on the command's real
stdio, exactly like `aqe-mcp`. entry.ts kicks off `main()` fire-and-forget, so
the action then awaits a never-resolving promise to keep the CLI wrapper from
exiting out from under the server; entry.ts owns shutdown.

Verified with the exact issue reproduction (piped stdin + EOF): `agentic-qe mcp`
now answers initialize AND tools/list (86 tools), matching the direct bundle.
Adds tests/integration/mcp/mcp-cli-inprocess.test.ts as a regression guard.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-17 13:12:00 +00:00