Commit Graph

2 Commits

Author SHA1 Message Date
Robin H. Johnson 03285cf471 doc: open-source license prep (#10)
Signed-off-by: Robin H. Johnson <rjohnson@coreweave.com>
2026-03-06 15:43:02 -07:00
Zubin Aysola bafb5f39c8 Fix eval workflow: target main, add Claude Code matrix (#3)
* Fix eval workflow: target main, add Claude Code agent matrix

- ref: wbaf-refact → ref: main
- Matrix strategy: benchmark both codex-mcp and claude-code
- Add ANTHROPIC_API_KEY for Claude Code agent
- Use all.yaml instead of codex-all.yaml (which no longer exists)
- Unique temp agent per matrix cell to avoid config collisions
- Separate README update job that aggregates results across agents

* Add install.sh, replace wandb skill with wandb-primary, update CI

- Add install.sh for easy skill installation (local or global Claude Code)
- Replace skills/wandb with skills/wandb-primary (comprehensive W&B + Weave skill
  with helper scripts and reference docs)
- Update README with installation instructions (npx skills + install script)
- Fix CI matrix: use codex and claude-code as base agents (not codex-mcp)
- Fix all wandb-primary-v2 path references to wandb-primary
- Remove stale .badges directory

* Overhaul CI: per-agent badges, wba-all eval source, no task name leaks

- Switch eval source from all.yaml to wba-all.yaml (W&B-specific tasks)
- Run update_all_eval.py before each eval to pick up new tasks
- Replace raw eval-log artifact with results-summary.json (counts only)
- Generate per-agent badge JSON files (.badges/codex.json, .badges/claude-code.json)
- Add Codex and Claude Code shield badges to README
- Keep eval_tasks input override for manual dispatch
- No task names, rubric content, or eval details leak to public artifacts

-- AI was used to create large parts of this PR
2026-03-05 13:18:06 -08:00