mirror of
https://github.com/vercel-labs/agent-eval.git
synced 2026-09-19 07:11:21 +08:00
Jude Gao
bc5114cea6
* [CLI] Live terminal dashboard for parallel experiment runs * Fix lint errors: remove unused renderDetailLine and verbose
1.2 KiB
1.2 KiB
Agent Eval
Development Guidelines
No New Environment Variables
Configuration should be done through the experiment config file, not environment variables.
- All experiment settings belong in
ExperimentConfig(seesrc/lib/types.ts) - The only acceptable env vars are API keys (e.g.,
AI_GATEWAY_API_KEY,ANTHROPIC_API_KEY,VERCEL_TOKEN) - When adding new configuration options, add them to the config schema in
src/lib/config.ts
DRY & Colocation
- Don't duplicate logic across files. If the same check exists in multiple places, extract it into a single function and import it.
- Colocate shared helpers in the module that owns the concept (e.g. classification logic belongs in
classifier.ts, not scattered acrosshousekeeping.tsandresults.ts).
Testing
- Always use the existing integration test framework (
src/integration.test.ts) for testing - Do not create standalone test scripts in
/tmp- they won't have proper module resolution - Run integration tests with:
INTEGRATION_TEST=1 npx vitest run src/integration.test.ts --testNamePattern="<pattern>"
Pull Requests
- Every PR that changes user-facing behavior should update the README
- Every PR should include a changeset (
npx changeset) for version management