mirror of
https://github.com/UditAkhourii/adhd.git
synced 2026-09-14 16:00:16 +08:00
75616bf73c
- bench/run-evals.ts — ADHD vs single-shot baseline across problem set,
LLM-as-judge scoring on breadth/novelty/trap-detection/actionability/
builder-usefulness with A/B order randomized per problem
- bench/problems.json — 6 open-ended engineering problems
- bench/judge.ts — separate critic pass with skeptical-staff-eng prompt
- EVALS.md — populated: ADHD 5W / 1L / 0T vs baseline
breadth +4.17, novelty +5.17, trap_detection +7.67,
actionability +3.00, builder_usefulness +0.83 (mean Δ across 6 problems)
- .github/workflows/ci.yml — typecheck + build on Node 18/20/22
- .github/workflows/evals.yml — manual-trigger eval run, artifacts uploaded,
EVALS.md committed back to main
- tsconfig.bench.json — typecheck covers bench/ too
- CONTRIBUTING.md — frame-authoring guide, eval-problem guide, loop invariants
- README badges (CI, Evals, npm, license, Node), Evals section