Commit Graph

23 Commits

Author SHA1 Message Date
Boden Fuller b29c6cd4b4 test: fix shellcheck in release harnesses 2026-05-02 18:46:12 -04:00
Boden Fuller a323f1a1c6 test: accept rpi implement lifecycle wording 2026-05-02 18:46:12 -04:00
Boden Fuller ba0f91a464 test: harden remaining claude skill prompts 2026-05-02 18:46:12 -04:00
Boden Fuller 9b43c3a412 test: stabilize implement skill smoke prompts 2026-05-02 18:46:12 -04:00
Boden Fuller 5db107d739 test: stabilize research skill smoke prompt 2026-05-02 18:46:12 -04:00
Boden Fuller 5475513ed3 test: stabilize research skill smoke prompts 2026-05-02 18:46:12 -04:00
Boden Fuller 9d63e982d5 test: accept crank behavior summary in smoke 2026-05-02 18:46:12 -04:00
Boden Fuller 92264c5f9b test: refresh release and claude smoke harnesses 2026-05-02 18:46:12 -04:00
Boden Fuller 2c5f192649 test: stabilize crank skill smoke prompt 2026-05-02 18:46:12 -04:00
Boden Fuller 8385cf6a64 chore: add release readiness gate 2026-05-02 18:46:12 -04:00
Boden Fuller 1be62ff37f test(quarantine): promote claude code suite 2026-04-11 23:10:04 -04:00
Boden Fuller 14744283ec fix(tests): delete 10k LOC coverage padding, quarantine 72 unused tests, add context_assemble coverage (na-fvs)
Wave 1 of CI Test Effectiveness epic:

- Delete 24 cov*_test.go files (10,527 LOC) that inflated coverage with
  trivial != "" assertions without testing behavior
- Move initGitRepo helper to uat_smoke_test.go (was in deleted file)
- Quarantine 72 shell tests requiring external runtimes (Claude, Codex,
  OpenCode) to tests/_quarantine/ — none were in CI
- Add 6 new context_assemble tests covering rune-safe truncation, Shannon
  entropy, high-entropy redaction, and history formatting
- Audit 7 set -uo pipefail scripts: all are test harnesses with failure
  counters — intentionally correct without -e
- Update coverage ratchet baseline

Issues: na-fvs.1, na-fvs.2, na-fvs.3, na-fvs.4
2026-03-05 00:12:28 -05:00
Boden Fuller 65d8855b12 feat(headless): add headless invocation standards and RPI phase runner
- Add bin/run-rpi-headless.sh: chains RPI phases as separate headless
  Claude invocations, each invoking the actual skills (/research, /plan,
  /crank, /vibe, /post-mortem) so the full skill chain executes
- Add docs/contracts/headless-invocation-standards.md: documents when to
  use --dangerously-skip-permissions (skill chains) vs --allowedTools
  (controlled prompts), timeout strategy, and session chaining
- Update test-helpers.sh: add --no-session-persistence, --max-budget-usd,
  configurable ALLOWED_TOOLS env var (default: skip-permissions for tests)
- Update release-smoke-test.sh: add --no-session-persistence,
  --max-budget-usd, scoped --allowedTools for fast test (no skill exec)

Key insight: skills chain skills — --allowedTools constrains the entire
session including tools used inside skill execution, so skill-invoking
workflows must use --dangerously-skip-permissions with timeout/budget
as the safety rails instead.
2026-03-02 10:08:14 -05:00
Boden Fuller ea67cdcbcb feat: complete 6-phase E2E validation (ag-aoh epic)
Adds pre-mortem gate blocking to test_gate_enforcement.
Final validation: 52 tests pass, 0 fail, 2 skip.
All 7 ag-aoh issues complete.

Closes: ag-aoh.7
evolve cycle 13
2026-02-22 21:33:30 -05:00
Boden Fuller 5ce598bdf3 feat: add phase summary validation tests to RPI E2E
Adds test_phase_summaries() with 6 assertions — one per phase:
- Validates .agents/rpi/phase-N-summary-*.md exists
- Checks non-empty content
- Enforces word count < 400 constraint
51 tests pass, 0 fail.

Closes: ag-aoh.6
evolve cycle 12
2026-02-22 21:32:43 -05:00
Boden Fuller 8338461c56 feat: add complexity scaling tests to RPI E2E
Adds test_complexity_scaling() with 4 assertions:
- 1-2 issues → --quick flag
- 3-7 issues → default (no flag)
- 8+ issues → --deep flag
- --fast-path/--deep mutex constraint
45 tests pass, 0 fail.

Closes: ag-aoh.5
evolve cycle 11
2026-02-22 21:32:17 -05:00
Boden Fuller 6a5c29d774 feat: add promise tag parsing tests to RPI E2E
Adds test_promise_tag_parsing() with 4 assertions:
- DONE promise tag detection
- BLOCKED promise tag detection
- PARTIAL promise tag detection
- Chain records all promise-derived statuses
41 tests pass, 0 fail.

Closes: ag-aoh.4
evolve cycle 10
2026-02-22 21:31:45 -05:00
Boden Fuller adf8c4950b feat: add gate retry simulation tests to RPI E2E
Adds test_gate_retry_logic() with 4 assertions:
- Pre-mortem FAIL → retry → PASS sequence
- Vibe FAIL → retry → PASS sequence
- Structured findings format (FINDING/FIX/REF)
- Max 3 attempt cap enforcement
37 tests pass, 0 fail.

Closes: ag-aoh.3
evolve cycle 9
2026-02-22 21:31:09 -05:00
Boden Fuller 20445b7075 fix: update vibe artifact path to .agents/council/ in E2E test
Vibe skill writes to .agents/council/ but test used .agents/vibe/.
Migrated all vibe references to .agents/council/, with validation-
specific file matching to avoid collision with pre-mortem artifacts.
33 tests pass, 0 fail.

Closes: ag-aoh.2
evolve cycle 8
2026-02-22 21:30:15 -05:00
Boden Fuller 10d70f3bf4 fix: split RPI E2E test into 6 phases (add pre-mortem + crank)
Phase 3 (Implement) → Phase 3 (Pre-mortem) + Phase 4 (Crank).
Adds test_premortem_artifacts with council verdict checks.
Renames old implement tests to test_crank_artifacts.
Updates ratchet chain from 5 to 6 phases.
33 tests pass, 0 fail, 2 skip.

Closes: ag-aoh.1
evolve cycle 7
2026-02-22 21:28:41 -05:00
Boden Fuller 35db3ed2d7 remove Agent Mail and distributed mode
Agent Mail was an experimental coordination layer for tmux-based
distributed workers. Local mode (native teams) covers all production
use cases. Removing to simplify the codebase before evolving remote
dispatch via bushido.

Deleted: inbox skill, agent-mail-protocol, 3 distributed-mode
reference docs, 2 test files. Edited 15 files to remove references.
2026-02-22 20:27:58 -05:00
Boden Fuller 1a78c745b4 prune goals 83→25, add trust-and-prove track specs
Council consensus: feature saturation reached. Removed 58 grep-for-string,
file-exists, and keyword-in-README goals. Kept only goals guarding real
mechanical invariants. Added Track 1 (RPI orchestrator stabilization) and
Track 2 (flywheel proof) evolution cycle specs.

Also includes pending security hardening, workflow fixes, and script cleanup.
2026-02-21 21:23:53 -05:00
Boden Fuller 37d4b5b2ae Merge branch 'codex/rpi-supervisor-cli' into main 2026-02-21 19:41:50 -05:00