Commit Graph

114 Commits

Author SHA1 Message Date
John Lindquist 25757fcc28 fix: gate verified playbook side effects
Ensure verified playbook metadata only reflects steps that were actually
applied so banner output, exposure attribution, and causality stay
consistent with runtime behavior.

Add deterministic verification coverage for apply versus no-op paths and
align the focused tests with the stricter contract to prevent regressions.

Ploop-Iter: 3
2026-03-28 12:44:36 -07:00
John Lindquist 7618898dad fix: harden verified playbook attribution
Keep verified playbook recall deterministic and credit-safe so learned
procedures improve guidance without distorting long-term routing policy.

Threading the playbook banner and reason metadata through the hook output
makes the contract inspectable, while forcing inserted steps to inherit the
anchor skill for exposure attribution prevents context helpers from stealing
policy wins or stale-miss credit from the originating skill.

Ploop-Iter: 2
2026-03-28 11:51:52 -07:00
John Lindquist 035a61534c feat: add verified playbook recall
Single-skill and pairwise memory were not preserving proven multi-step workflows, so repeated verification wins could not compound into reusable procedure. Persisting promoted playbooks and recalling them during injection lets the plugin reuse validated sequences, keeps learn output deterministic across JSON/text/write flows, and adds regression coverage so procedural memory stays accretive instead of speculative.

Ploop-Iter: 1
2026-03-28 10:49:00 -07:00
John Lindquist 0ceb348038 feat: add routing decision causality
Persist first-class causal evidence in routing traces so diagnosis can explain why skills were matched, boosted, recalled, linked, or dropped without inferring intent from ranked order alone.

Teach session-explain to prefer explicit causes and edges so operator output stays correct as routing grows more synthetic and route-scoped, while preserving safe fallback behavior for older traces.

Ploop-Iter: 3
2026-03-28 08:56:04 -07:00
John Lindquist bb7f86156a feat: diagnose companion recall routing
Expose companion recall in session diagnostics so operators can verify that verified-companion routing remains causal, synthetic, and subordinate to stronger direct or policy-driven matches.

Locking these expectations into regression coverage reduces the risk of attribution drift, hidden policy contamination, and debugging blind spots as routing logic evolves.

Ploop-Iter: 2
2026-03-28 07:55:21 -07:00
John Lindquist dfb42efc78 feat: learn and recall verified skill companions
Improve routing by preserving companion skill pairs that consistently close verification gaps, so repeated scenarios can surface complementary skills automatically instead of relearning the pairing every session.

Keep companion evidence separate from single-skill policy credit and expose the learned artifact through the learn CLI and routing diagnostics so promotion decisions stay explainable, replayable, and safe to inspect.

Also record recalled companions explicitly in decision traces so routing-explain and other observability surfaces can identify companion injections reliably.

Ploop-Iter: 1
2026-03-28 06:24:48 -07:00
John Lindquist 8da3ba0250 feat: add verification closure diagnostics
Capture why PostToolUse verification observations do or do not close\nrouting policy so agents and developers can distinguish gate failures\nfrom zero-match exposure misses without replaying ledger state by hand.\n\nPersisting append-only closure capsules preserves negative-path receipts\nand makes the verification loop auditable, deterministic to test, and\nsafer to evolve as routing resolution logic becomes more nuanced.\n\nPloop-Iter: 3
2026-03-28 05:12:20 -07:00
John Lindquist 1130b3daca feat: gate verification policy on local provenance
Prevent external fetch observations from training routing policy and keep verification attribution tied to the story that actually owns the observed route. This makes oracle feedback more trustworthy and keeps gate telemetry machine-readable for regression coverage.

Ploop-Iter: 2
2026-03-28 04:13:14 -07:00
John Lindquist d4fbb08360 feat: broaden verification signal observation
Verification guidance was too dependent on Bash-only evidence, which left useful observations from reads, grep, glob, and fetch operations invisible to the planner. Normalizing those signals lets the verification loop keep state from more of the agent's actual behavior.

The routing policy also needed stronger attribution discipline so soft evidence can inform plan progress without being over-credited as a successful verification outcome. Closing that gap protects route-scoped learning, prevents stale exposures from lingering silently, and gives the policy ledger cleaner data to learn from over time.

Ploop-Iter: 1
2026-03-28 03:36:10 -07:00
John Lindquist 4cc886d528 feat: persist learned routing rulebooks
Promote replay-verified routing decisions into a canonical project-scoped rulebook so runtime ranking can apply stable learned guidance and decision capsules can expose provenance without re-deriving routing state.

Normalize demotion boosts to stored magnitudes so compiler-produced rulebooks preserve runtime precedence semantics and cannot invert a demotion into an accidental promotion.

Ploop-Iter: 3
2026-03-28 02:18:32 -07:00
John Lindquist 7eaf6ca5e4 feat: separate learned promotions from policy evidence
Keep routing-policy as an observational ledger so learned promotion runs do not fabricate wins, exposures, or demotions into the evidence store. This preserves ground truth for later analysis while still producing a deterministic promotion artifact that downstream tooling can inspect and apply safely.

Tighten replay gating around observed verification outcomes so pending placeholder traces from PreToolUse do not count as verified success. That keeps learn-mode promotion decisions aligned with the real verification lifecycle and prevents false positive promotions or regressions.

Ploop-Iter: 2
2026-03-28 01:05:04 -07:00
John Lindquist 64b609cb5b feat: add verified rule learning workflow
Enable routing improvements to be promoted from verified evidence instead of relying on manual policy tuning.

Deterministic replay gating keeps learned rules safe to adopt, and project-scoped session discovery prevents unrelated tmp artifacts from contaminating learning results across worktrees.

Ploop-Iter: 1
2026-03-27 23:58:55 -07:00
John Lindquist 56bf864bd9 feat: add verified prompt policy recall
Recover historically successful skills during prompt submission when direct prompt matching misses, so active verification flows can still surface the right help instead of failing closed on zero-match paths.

Expose the recalled path in doctor, trace, and attribution output so operators can understand why a skill was injected and trust the policy loop when it promotes a proven route-scoped winner.

Ploop-Iter: 5
2026-03-27 22:51:48 -07:00
John Lindquist e03f8b9584 feat: bind prompt routing to verification boundaries
Prompt-time routing only becomes useful training data when it can be
resolved against a concrete verification boundary. Binding prompt
decisions to the plan's predicted boundary avoids stale exposures and
prevents policy learning from synthetic none|none scenarios.

Ploop-Iter: 4
2026-03-27 21:48:44 -07:00
John Lindquist 8dbd78313b ploop: iteration 3 checkpoint
Automated checkpoint commit.

Ploop-Iter: 3
2026-03-27 20:37:06 -07:00
John Lindquist b4d0c0a36c feat: attribute routing policy credit precisely
Prevent co-injected helper skills from distorting long-term routing policy so policy learning stays tied to the skill that actually drove an injection. This keeps verification outcomes and replay data fully observable while making future ranking decisions more causally accurate and stable.\n\nAlso surface manifest exclusion parity and directive-env fallback details in session diagnostics so operators can understand why a skill is absent and why a verification closure did or did not resolve.\n\nPloop-Iter: 2
2026-03-27 19:02:03 -07:00
John Lindquist 575d359b3b feat: scope verification state by story
Keep verification evidence and next-action planning isolated per story so
multi-route sessions do not contaminate each other.

Align downstream consumers with the active-story projection and make
session auto-detection prefer the freshest ledger activity so routing
policy recall, directives, and CLI output stay coherent.

Ploop-Iter: 1
2026-03-27 17:51:50 -07:00
John Lindquist c43be00e3e feat: explain routing recall decisions
Expose deterministic routing-diagnosis data at the decision edge so
operators and downstream agents can understand why route-scoped
recall did or did not fire without changing routing behavior.

Extend session-explain with the same additive diagnosis surface to
make recent routing outcomes inspectable in CI and local debugging,
which reduces guesswork when policy history, precedence, or missing
signal affect recall.

Ploop-Iter: 3
2026-03-27 16:53:59 -07:00
John Lindquist 3bbedb4f5a fix: harden route-scoped policy recall
Keep historically verified recall from overriding stronger live matches while preserving traceability and repeatable rebuild behavior.

Restore the excluded test-skill provenance so manifest-backed diagnostics and session explain output continue to reflect the repo's exclusion policy instead of silently drifting after regeneration.

Ploop-Iter: 2
2026-03-27 15:52:29 -07:00
John Lindquist 154bedc23a feat: add route-scoped policy recall
Route-aware recall lets the injector reuse historically verified winners when pattern matching misses them, improving skill selection without weakening strict story and route attribution.

Persisting exact-route, wildcard, and legacy policy buckets preserves backward compatibility while creating enough evidence to boost and recall skills conservatively across similar flows.

Ploop-Iter: 1
2026-03-27 15:00:13 -07:00
John Lindquist 10e08bce2a feat: unify session diagnostics and skill exclusions
Align control-plane diagnostics with manifest generation so operators and
agents see the same runtime truth instead of divergent live-scan results.
This preserves trust in routing and doctor output when fixture skills exist
and gives one place to inspect session state during verification work.

Harden the new snapshot path so broken generated state degrades into
actionable diagnostics instead of a command crash, which keeps debugging
workflows usable when manifests drift or become malformed.

Ploop-Iter: 3
2026-03-27 12:20:41 -07:00
John Lindquist 8b1e288ad6 test: harden verification routing parity
Keep runtime routing evidence trustworthy by preventing test-only skills\nfrom leaking into the generated manifest and by locking the\nverification directive handoff to a stable env contract.\n\nThese checks reduce false routing attribution, catch manifest/live-scan\ndrift before it reaches hook behavior, and make end-to-end verification\nresolution deterministic across SubagentStart and PostToolUse.\n\nPloop-Iter: 2
2026-03-27 11:33:24 -07:00
John Lindquist 83f032c8d1 feat: unify verification directive flow
Move verification handoff into a shared directive contract so top-level hooks and subagents resolve the same story, route, and next action across tool boundaries.

Export deterministic verification env clearing and route-aware fallback behavior to prevent stale state from leaking between calls and to let PostToolUse close policy exposures even when command inference is incomplete.

Add focused tests around banner export and directive-win closure so the verification loop stays stable as routing policy logic evolves.

Ploop-Iter: 1
2026-03-27 10:48:50 -07:00
John Lindquist 743a0152b7 feat: harden routing replay learning
Make routing learning trustworthy enough to drive policy updates from replayed evidence instead of loosely correlated observations.

This keeps route and story attribution honest, preserves enough trace detail to reconstruct routing decisions deterministically, and enables bounded policy tuning from session outcomes without teaching on ambiguous signals.

Ploop-Iter: 4
2026-03-27 09:18:12 -07:00
John Lindquist 5e546b0a78 ploop: iteration 3 checkpoint
Automated checkpoint commit.

Ploop-Iter: 3
2026-03-27 03:01:28 -07:00
John Lindquist c9640cbe55 fix: scope routing policy evidence
Prevent routing-policy learning from over-crediting skills across unrelated verification stories or routes. This keeps adaptive ranking tied to the active verification thread so future injections learn from relevant evidence instead of noisy session-wide matches.

Harden session-scoped exposure storage so unusual session identifiers cannot leak into tmp filenames, and keep generated artifacts free of stray orphan test fixtures that would pollute validation and manifest state.

Ploop-Iter: 2
2026-03-27 01:36:39 -07:00
John Lindquist b20fb3b765 feat: add verified routing policy
Persist routing outcomes and exposures so skill selection can learn from
verified boundary observations instead of relying only on static pattern
weights.

Align explain output and regression coverage with the runtime injector so
the adaptive policy remains inspectable and deterministic as the routing
ledger evolves.

Ploop-Iter: 1
2026-03-26 22:58:12 -07:00
John Lindquist c311be9129 feat: close verification feedback loop
Persist verification observations and expose adherence snapshots so the plugin can replan from real execution evidence instead of only static intent.

This gives downstream agents a stable machine-readable view of whether the last verification action followed guidance, which makes the autopilot loop more reliable and easier to regress-test.

Ploop-Iter: 3
2026-03-26 21:20:26 -07:00
John Lindquist 5e6bf6d8e7 feat: add verification directive handoff
Carry verification intent across subagent boundaries so agents can
receive a deterministic next step and downstream hooks can confirm
whether the requested verification actually happened.

Keep verification planning resilient when cached state is missing or
stale by recomputing from ledger data, and log fallback failures so
runtime proof paths do not fail silently during debugging.

Ploop-Iter: 2
2026-03-26 20:16:40 -07:00
John Lindquist 043f6af50e feat: add verification planning workflow
Preserve a deterministic verification trail so troubleshooting guidance can
advance from observed evidence instead of repeating generic next steps.

Surface one ranked verification action and scoped context to the CLI,
hooks, and subagents so agents can continue the same investigation with
clear boundary coverage and less duplicated probing.

Ploop-Iter: 1
2026-03-26 19:04:09 -07:00
melkeydev 96c3cb0743 fixing ci 2026-03-23 11:09:46 -07:00
melkeydev 2148556d27 adding new skill 2026-03-23 10:51:57 -07:00
melkeydev eab4da0aba fixing readme and CI 2026-03-22 15:51:45 -07:00
melkeydev 44d8248160 removing vercel-firewall skill 2026-03-22 14:43:53 -07:00
melkeydev c2d6e61dd0 Removing Satori 2026-03-22 14:38:33 -07:00
melkeydev 0940ee70c5 removing payments 2026-03-22 14:35:22 -07:00
melkeydev a9b8bee401 removing geist docs 2026-03-22 14:07:14 -07:00
melkeydev 83dea37473 Removing geist 2026-03-22 14:06:32 -07:00
melkeydev 2fcdd662b3 removing CMS 2026-03-22 14:01:33 -07:00
melkeydev 90b6504628 fixing our skills with a proper engine 2026-03-22 13:48:55 -07:00
melkeydev ef93bf49ca fixing template broken builds 2026-03-21 22:01:57 -07:00
melkeydev aeb71be011 editing status.md for project status 2026-03-18 21:57:14 -07:00
melkeydev 3c50276108 fixing telemetry to be base tracking and anonymous 2026-03-18 10:46:28 -07:00
melkeydev abd9ed613a fixing for telemetry 2026-03-18 09:57:56 -07:00
melkeydev 637de60acb Remove accidental fake-banned-test-skill 2026-03-15 21:24:07 -07:00
melkeydev 34ac109f3b Rebuild generated manifests after rebase 2026-03-15 21:18:04 -07:00
melkeydev a2cbc8e45e fixing and making telemetry more stable 2026-03-15 21:15:20 -07:00
Andrey Buzin 76d6dd11aa Run codegen 2026-03-13 12:56:41 -07:00
Andrey Buzin b0240a6696 Remove extra references, prune the skill and narrow down its focus 2026-03-13 12:49:50 -07:00
Andrey Buzin e7a631ee76 Add vercel-services skill
Wire in vercel-services
2026-03-13 12:49:50 -07:00