ruvnet
e332689b8c
fix(release): harden hooks, statusline, security, and plugin MCP integration
2026-07-16 23:06:29 -04:00
ruv
0403a34279
feat(cost-tracker): wire codemod benchmark into cost-trend (ADR-143 follow-up)
...
The codemod benchmark now writes its run JSON (tagged summary.benchmark=
"codemod-tier1") into the cost-tracker plugin's runs dir — the exact path
cost-trend reads — instead of a stopgap repo-docs location. cost-trend is now
benchmark-aware: BENCH_NAME=codemod-tier1 shows the codemod series, while the
default trend keeps showing only legacy booster runs (untagged / "booster"),
so the two corpora never conflate.
Co-Authored-By: RuFlo <ruv@ruv.net >
2026-05-29 17:28:27 -04:00
Reuven
02eee0bcdc
docs(adr): bulk-update plugin contract ADR statuses (sweep)
...
- 27 plugins moved Proposed → Accepted (shipped versions, in marketplace)
- 0 plugins kept as Proposed (all have real versions ≥ 0.2.0)
Per-plugin breakdown:
ruflo-aidefence v0.2.0 Accepted — 3-gate pattern, 6 aidefence_* tools
ruflo-autopilot v0.2.0 Accepted — 10 autopilot_* tools, /loop integration
ruflo-core v0.2.1 Accepted — MCP server contract, plugin-catalog discovery
ruflo-cost-tracker v0.16.1 Accepted — namespace-routing fix, ADR-097 budget integration
ruflo-daa v0.2.0 Accepted — 8 daa_* tools, intelligence-pipeline alignment
ruflo-ddd v0.2.0 Accepted — AgentDB domain graph, SPARC Architecture-phase
ruflo-docs v0.2.0 Accepted — document worker dispatch, drift detection
ruflo-federation v0.2.0 Accepted — ADR-097 Phase 1+2, 3-gate alignment
ruflo-goals v0.2.0 Accepted — 6 namespaces, GOAP + dossier ADR-099
ruflo-iot-cognitum v0.2.0 Accepted — 5-tier trust, 6 background workers
ruflo-jujutsu v0.2.0 Accepted — 6 analyze_* tools, ADR-compliance cross-link
ruflo-knowledge-graph v0.2.0 Accepted — embeddings_generate fix, pathfinder
ruflo-loop-workers v0.2.0 Accepted — 12 worker triggers, 5 hooks_worker-* tools
ruflo-market-data v0.2.0 Accepted — embeddings + namespace-routing bugs fixed
ruflo-migrations v0.2.0 Accepted — namespace-routing bug fixed both skills
ruflo-neural-trader v0.2.0 Accepted — 4 namespaces already compliant
ruflo-observability v0.2.0 Accepted — namespace-routing bug fixed both skills
ruflo-plugin-creator v0.2.0 Accepted — scaffolding templates updated with contract
ruflo-rag-memory v0.2.0 Accepted — claude-memories reserved namespace consumer
ruflo-ruvllm v0.2.0 Accepted — LLM-config + chat-format slice ownership
ruflo-rvf v0.2.0 Accepted — portable-memory + session-persistence slice
ruflo-security-audit v0.2.0 Accepted — 3-gate + audit_1776853149979 regression class
ruflo-sparc v0.2.0 Accepted — all 5 SPARC phases cross-linked
ruflo-swarm v0.2.0 Accepted — 12 MCP tools (4 swarm_* + 8 agent_*)
ruflo-testgen v0.2.0 Accepted — testgaps worker + coverage CLI commands
ruflo-wasm v0.2.0 Accepted — 10 wasm_* tools, ADR-070 cross-ref
ruflo-workflows v0.2.0 Accepted — 10 workflow_* tools, SPARC phase transitions
Each ADR received: updated: 2026-05-09 in frontmatter + Implementation status
section noting version, marketplace presence, and contract element alignment.
Co-Authored-By: RuFlo <ruv@ruv.net >
2026-05-09 15:10:42 -04:00
Reuven
9c706d28a8
docs(cost-tracker): ADR-0003 + corpus v3 bench refresh (v0.16.0)
...
All 11 priorities from this session's implementation list are landed.
ADR-0003 documents the v0.4 → v0.15 arc — what shipped, what's
deferred (real MCP tool registration, upstream memory-store UNIQUE
fix, federation Phase 3 producer), and the riskiest assumptions.
Also persists the freshest measured bench (corpus v3, 25 cases, all
4 endpoints) — strongest verification yet:
| Endpoint | Tier 1 | Adv | Avg latency | Cost/edit | Speedup |
|-----------------|--------|------|-------------|------------|---------|
| Booster (WASM) | 18/18 | esc | 0.36 ms | $0 | — |
| Gemini 2.0 | 18/18 | 3/7 | 807.56 ms | $0.000028 | 2243× |
| Sonnet 4.6 | 18/18 | 2/7 | 1270.64 ms | $0.000933 | 3530× |
| Opus 4.7 | 18/18 | 5/7 | 1563.72 ms | $0.005943 | 4344× |
New finding: Sonnet 4.6 only solves 2/7 adversarial cases — booster's
"correctly refuse" path beats Sonnet on routing-correctness, not just
speed.
Smoke step 8 now also verifies ADR-0002 + ADR-0003 are Accepted.
Cron c0b44f45 cancelled — implementation list complete.
Version: 0.15.0 → 0.16.0.
Co-Authored-By: RuFlo <ruv@ruv.net >
2026-05-05 00:16:16 -04:00
Reuven
c16114659a
feat(cost-tracker): P7 — corpus v3 expansion (16 → 25 cases) (v0.10.0)
...
Stronger verification — adds 6 Tier 1 + 3 adversarial cases.
Tier 1 added (booster should apply):
- var-to-let-1, double-quote-to-single, add-readonly-prop,
remove-debugger, import-add-named, remove-trailing-semis
Adversarial added (booster should escalate):
- adversarial-extract-class (class delegation refactor)
- adversarial-callback-to-promise (control-flow rewrite)
- adversarial-deeply-nested-conditional (guard-clause flattening)
Live verified on the 25-case corpus:
- Tier 1 win rate: 100% (18/18)
- Escalation rate: 100% (7/7) — every adversarial case fell below
0.5 confidence threshold, min 0.000
- Avg latency: 0.32 ms (improvement; new Tier 1 cases are simpler)
- Booster's qualitative win is unchanged: correct apply + correct
refuse, faster than any LLM
Smoke step 24 now requires 18+ Tier 1, 6+ adversarial, 25+ total.
Corpus version: 2 → 3. Plugin: 0.9.0 → 0.10.0.
Co-Authored-By: RuFlo <ruv@ruv.net >
2026-05-05 00:01:17 -04:00
Reuven
0fd61e3e5b
feat(cost-tracker): ADR-0002 — verified Agent Booster integration (v0.4.0)
...
Wires `npm agent-booster` (Tier 1, WASM, $0/edit, sub-millisecond) into
the cost-tracker plugin and proves the speedup against frontier LLMs
running on the deployed GCP endpoints — Gemini 2.0 Flash, Claude
Sonnet 4.6, and Claude Opus 4.7.
What lands:
- ADR-0002 (Accepted): 6 decisions covering booster routing, optimizer
bridge, model-outcome feedback loop, loop-worker consumption,
tier-aware reporting, and the version+keywords bump.
- 4 new skills: cost-booster-route (router-side classifier),
cost-booster-edit (direct apply via agent-booster.apply()),
cost-benchmark (corpus harness), cost-compact-context (token-optimizer
bridge with graceful fallback).
- Updates to 2 existing skills: cost-optimize closes the
hooks_model-outcome loop; cost-report now reads measured booster data
from runs/latest.json and aggregates by tier.
- New `cost benchmark [--llm] [--anthropic]` subcommand.
- 16-case verification corpus (12 Tier 1 + 4 adversarial), bench.mjs
harness with split metrics (winRate / escalationRate / overallCorrect)
and gcloud-secret-aware LLM/Anthropic baselines.
- Smoke contract grew 10 → 27 checks, ~85 ms wall-time.
Verified live (16 cases, 4 endpoints, 2026-05-05):
Endpoint Tier 1 Adversarial Avg latency Cost/edit
Booster (WASM) 12/12 escalates 4/4 0.50 ms $0
Gemini 2.0 Flash 12/12 3/4 762.13 ms $0.000027
Claude Sonnet 4.6 12/12 3/4 1158.06 ms $0.000982
Claude Opus 4.7 12/12 3/4 1517.94 ms $0.006049
Measured speedups (booster vs LLM): 1524× / 2316× / 3036× — exceed
upstream's 350× claim against every endpoint. All three LLMs
(including Opus 4.7) failed on the same adversarial case; booster
correctly refused all four with min confidence 0.000.
Proof: https://github.com/ruvnet/ruflo/issues/1743
https://gist.github.com/ruvnet/15fae7a5495026f025fb3baf721c20ea
Co-Authored-By: RuFlo <ruv@ruv.net >
2026-05-04 23:35:52 -04:00
Reuven
9dc248700c
fix(ruflo-cost-tracker): v0.2.2 — fix namespace-routing bug + adopt plugin contract (ADR-0001)
...
The cost-report and cost-optimize skills passed namespace arguments to
agentdb_hierarchical-recall and agentdb_pattern-store, but those tool
families route by tier and ReasoningBank respectively — namespace strings
are silently ignored (per ruflo-agentdb ADR-0001 §"Namespace convention").
The skills' CLI examples have always been correct (memory_store/_search
with --namespace cost-tracking / cost-patterns); the MCP tool mapping
was wrong.
Functional fixes:
- cost-report skill: load path switches from agentdb_hierarchical-recall
to memory_search/_list/_retrieve. allowed-tools updated.
- cost-optimize skill: load path switches to memory_search; documents
both write paths explicitly:
1. agentdb_pattern-store (ReasoningBank-routed; no namespace arg;
fallback lands in reserved 'pattern' namespace)
2. memory_store --namespace cost-patterns (namespace-routable; lands
in cost-patterns as the agent file's CLI examples promise)
Contract additions:
- ADR-0001 (Proposed) at docs/adrs/0001-cost-tracker-contract.md
- README adds Compatibility (pin v3.6), Namespace coordination (claims
cost-tracking + cost-patterns; routing-note callout; defers to
ruflo-agentdb ADR-0001), Verification + Architecture Decisions sections
- plugin.json bumps 0.2.1 → 0.2.2 (patch — public command surface
unchanged; skill internals fixed); keywords add namespace-routing, mcp
- scripts/smoke.sh — 10 structural checks: version + keywords, skills
present, skills use memory_* not hierarchical-*, dual pattern-store
paths documented, v3.6 pin, namespace coordination block, federation
budget pairing (ADR-097) block intact, ADR Proposed, REFERENCE.md
non-empty, no wildcard tools
Verification: bash plugins/ruflo-cost-tracker/scripts/smoke.sh → 10/10
Co-Authored-By: RuFlo <ruv@ruv.net >
2026-05-04 19:55:24 -04:00