Commit Graph

4 Commits

Author SHA1 Message Date
Abhitej John a26c711124 held-out grid (sonnet46): replace eval.vally.yaml with 5 fresh untuned scenarios 2026-07-20 04:38:06 -07:00
Abhitej John 5429c2f621 Add 2 fresh mixed-intent boundary fixtures; revert executor to opus-4.6
Closes the 'refactoring-only endpoint too narrow' risk flagged by the
cross-family rubber-duck. Adds two boundary stimuli never used in trim tuning:
  9. Separate a smuggled behavior change from a requested rename (rename +
     smuggled 10%->12% discount change) -> should separate/flag, not bundle.
 10. Recognize a behavior-changing simplification is not a refactor (remove
     free-shipping-over-\ rule under a 'cleanup' framing) -> should not
     silently change observable behavior.
Executor reverted to claude-opus-4.6 / judge gpt-5.5 (re-judge) to match the
stringent Confirm A family where boundary behavior looked weakest.
Eval-branch only; not on PR #873.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3c9f9823-7f2f-4f7d-9d1b-f2b9e7a20c60
2026-07-19 23:24:41 -07:00
Abhitej John c6b09b071b Add vally evals + cost-trim for dotnet refactoring/breaking-change skills
CI-only eval branch (NOT part of PR #873). Carries the uncommitted
cost-trim + PR-comment fix on both SKILL.md, the eval.yaml rubric
re-alignment, and two new eval.vally.yaml specs so the vally CI can
evaluate whether the current skill content helps before merging.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3c9f9823-7f2f-4f7d-9d1b-f2b9e7a20c60
2026-07-17 10:39:54 -07:00
Abhitej John 1b3a5bd13d Add eval tests for csharp-refactoring and dotnet-breaking-changes skills
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
2026-07-07 16:48:18 -07:00