Zubin Aysola e60d97f05d Fix path mismatches in eval workflow
uv run --directory wbaf sets cwd to wbaf/, so Python paths must
not include the wbaf/ prefix. Shell commands (mkdir, echo fallback)
run from workspace root and keep the prefix.

Verified end-to-end in a tempdir simulating the CI checkout layout.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-05 14:15:34 -08:00
2026-02-23 16:19:31 -07:00

agent-skills

Evaluate Skills Codex Claude Code

Agent skills for working with Weights & Biases. Explore projects, analyze runs, query metrics, and create reports — all from your coding agent.

Supported Coding Agents

These skills can be installed for any agent supported by skills.sh, including Claude Code, Cursor, Windsurf, Goose, and many more.

Prerequisites

Installation

Quick Install

Using npx skills:

Local (current project):

npx skills add wandb/agent-skills --skill '*' --yes

Global (all projects):

npx skills add wandb/agent-skills --skill '*' --yes --global

To link skills to a specific agent (e.g. Claude Code):

npx skills add wandb/agent-skills --agent claude-code --skill '*' --yes --global

Install Script (Claude Code only)

Alternatively, clone the repo and use the install script:

git clone https://github.com/wandb/agent-skills.git
cd agent-skills

# Install for Claude Code in current directory (default)
./install.sh

# Install for Claude Code globally
./install.sh --global

# Force reinstall without prompts
./install.sh --force --yes
Flag Description
--global, -g Install globally instead of current directory
--force, -f Overwrite skills with same names as this package
--yes, -y Skip confirmation prompts

Usage

After installation, set your API key:

export WANDB_API_KEY=<your-key>

Then run your coding agent from the directory where you installed (for local installs) or from anywhere (for global installs).

Available Skills

Skill Description Status
wandb-primary Comprehensive primary skill for W&B SDK (runs, metrics, artifacts, sweeps) and Weave SDK (traces, evaluations, scorers) evaluated

Skill Format

Each skill is a directory under skills/ with a SKILL.md file:

skills/<name>/
└── SKILL.md          # YAML frontmatter + instructions

SKILL.md structure

---
name: my-skill
description: One-line description of when to use this skill.
---

# Skill Title

Instructions, code patterns, and best practices for the agent...

The frontmatter requires name and description. The body contains instructions that get injected into the agent's context.

Evaluation

Skills are automatically evaluated on merge to main using the WandBAgentFactory eval framework, benchmarked against both Codex and Claude Code agents. Results are tracked in Weave.

Contributing

  1. Create skills/<your-skill>/SKILL.md with frontmatter and instructions
  2. Open a PR — CI will run the skill through the eval suite
  3. Merge to main to publish

To update an existing installation:

./install.sh --force
S
Description
Primary W&B skill for broad or mixed Weights & Biases work: project overviews, W&B runs and artifacts, Weave traces and evaluations, Reports, and Launch…
Readme Apache-2.0 774 KiB
Languages
Python 99.3%
Shell 0.7%