Files
Colby McHenry 9cf671acf5 chore(agent-eval): add per-repo WITH-only why-Read benchmark harness
bench-why-repo.sh runs one README repo, WITH-codegraph only, N runs, each
appending a why-Read diagnostic ("if you Read/Grep, explain why codegraph fell
short; end with a ## Why I read section"). Honors EFFORT (default high) and
kills the per-repo daemon before each run so it serves the current dist. The
WITHOUT baseline is codegraph-independent and lives in the README, so it's not
re-run. Used to validate the explore reshape: all 7 README repos, 28/28 runs,
0 Read / 0 Grep on effort=high.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-02 08:32:09 -05:00
..