vercel-labs__agent-eval/CLAUDE.md

Agent Eval

Development Guidelines

No New Environment Variables

Configuration should be done through the experiment config file, not environment variables.

• All experiment settings belong in ExperimentConfig (see src/lib/types.ts)
• The only acceptable env vars are API keys (e.g., AI_GATEWAY_API_KEY, ANTHROPIC_API_KEY, VERCEL_TOKEN)
• When adding new configuration options, add them to the config schema in src/lib/config.ts

Testing

• Always use the existing integration test framework (src/integration.test.ts) for testing
• Do not create standalone test scripts in /tmp - they won't have proper module resolution
• Run integration tests with: INTEGRATION_TEST=1 npx vitest run src/integration.test.ts --testNamePattern="<pattern>"