Files
copilotkit__copilotkit/showcase/scripts/fail-baseline.json
Jordan Ritter c7e67b90f4 chore(showcase): ratchet validate-pins baseline 48 -> 39
Pin alignment fixes 9 validate-pins FAILs; ratchet the drift baseline
count and hash accordingly. Also tighten the _comment: document the exact
hash recipe (SHA-256 of the stderr-only [FAIL] lines, LC_ALL=C sort -u)
and correct baselineDemoCount semantics (exact expected demo count per
package; deviation either direction warns).
2026-06-10 15:02:30 -07:00

7 lines
1.1 KiB
JSON

{
"_comment": "Drift ratchet baseline for showcase_validate.yml. `validatePinsFailCount` holds the last-known FAIL count; `validatePinsFailHash` is a SHA-256 of the stderr-only `[FAIL] ...` lines from validate-pins.ts, deduplicated and sorted with `LC_ALL=C sort -u`. CI compares BOTH: if the count changes, it tells you to ratchet (up rejected, down instructed). If the count is equal but the hash differs, the FAIL *set* has drifted (one item fixed, another regressed) and CI fails with a diff. Never raise the count without an explicit review + sign-off. `baselineDemoCount` is the exact expected demo count per package (single source of truth consumed by both the workflow and validate-parity.ts); deviation in either direction triggers a baseline-deviation warning. NOTE: validate-parity.ts `BASELINE_DEMO_COUNT` default must match `baselineDemoCount` here; keep them in sync. See .github/workflows/showcase_validate.yml 'Run validate-pins (ratchet)' step.",
"validatePinsFailCount": 39,
"validatePinsFailHash": "f9b376e3223460a67a7808287d707cfcaf44a6f234fcb7539e5e3fa6c6d1ee24",
"baselineDemoCount": 9
}