Commit Graph

3 Commits

Author SHA1 Message Date
Jordan Ritter db62915362 fix(showcase): restore eval system accidentally deleted by #4449
PR #4449 removed the eval tier system while unaware #4448 had just
merged. Restoring orchestrator, matrix, scope, config, GHA workflow,
and CLI wiring with all 8 CR fixes intact.
2026-04-29 20:11:33 -07:00
Jordan Ritter 5abf0409a8 fix(showcase): D5 test infrastructure and CLI improvements
- Rewrite cmd-test.sh to use harness CLI for D5 probes
- Add run-e2e-with-aimock.sh helper (removed stale version)
- Update fail-baseline hash for D5 coverage
- Fix provider base URLs in .env.example
- Update local-ports.json for spring-ai
- Remove eval tier system (superseded by D5 depth probes)
- Add D5 debugging runbook
2026-04-29 19:40:10 -07:00
Jordan Ritter eaf8724bf1 feat(showcase): add eval tier configuration and gitignore entries
Add eval-tiers.json defining three evaluation tiers (Gold Standard,
Key Partners, Full Matrix) with fail-fast on tier 1. Add gitignore
entries for .eval-results/ and .eval-baseline.json local artifacts.
2026-04-29 18:47:36 -07:00