* chore(stdlib): add conformance tooling for the skills library
The library had no gate that could express what a valid skill is, so
malformed frontmatter, over-budget files and credential literals went
unnoticed. These scripts define and enforce that contract.
- validate-skills.py: extend with Agent Skills v1.0 conformance -
naming rules and directory agreement, an explicit activation trigger
in the description, canonical layout, the 500-line SKILL.md budget,
relative-link integrity, and two security rules (no unrestricted
Bash(*) grant, no credential literals). Structural checks now read a
skill as a whole so material moved into references/ still counts.
- split-skill-references.py: move the heaviest sections of an oversized
SKILL.md into references/. Verifies line by line that every source
line lands in exactly one output and refuses to write otherwise.
- generate-skill-inventory.py: derive SKILLS_INVENTORY.md and
DIRECTORY_STRUCTURE.md from the tree so they cannot drift.
- generate-skill-catalog.py: index the canonical layout only, count
references/ toward a skill's size, and stop truncating descriptions
at 200 characters - the catalog is the discovery surface and must
carry the activation trigger.
- .gitignore: Python bytecode from these scripts, and local .pcl state.
Reviewed-by: Security Analyst, Compiler Engineer, DevX Engineer
* fix(stdlib): bring all 174 skills to Agent Skills v1.0 conformance
No skill in the library was conformant. 41 of 175 failed the existing
validator outright, and none satisfied the spec. This pass fixes the
tree and records the result. See stdlib/CHANGELOG.md for the per-skill
versioning and migration notes.
BREAKING CHANGE: one skill removed, five moved, seven with a capability
withdrawn. Library version 2.0.0 -> 3.0.0.
Structure
- Convert 71 skills stored as flat files to <category>/<name>/SKILL.md,
the layout the spec requires and the only one able to carry companion
resources.
- Rename 5 directories that disagreed with their declared name:, so
resolution by path and by name stop giving different answers. The
repository docs already referenced the corrected paths.
- Merge the duplicate legal-technology skills into legaltech-expert and
delete legal-tech-expert, carrying over everything the survivor
lacked.
Metadata
- Repair 20 unparseable frontmatters: an H1 preceded the --- block and
the key was skill_id: instead of name:, so any parser reading
frontmatter at offset 0 saw no metadata at all. The objectives,
prerequisites and outcome they carried become real body sections.
- Add the missing version: to 21 skills, fold keywords into tags, move
expertise_level under metadata, and align 10 category: values with
their directory.
Discoverability
- Give all 174 descriptions an explicit "Use when ..." trigger, built
from each skill's own tags and section headings. 152 previously said
only what the skill was about, leaving an agent nothing to match on.
Progressive disclosure
- Split 127 oversized skills, moving bulk material into references/ read
on demand and leaving an index behind. A SKILL.md now averages 277
lines instead of 644 and none exceeds 500. Verified lossless line by
line against the previous revision.
Security
- Withdraw the unrestricted Bash(*) grant from 7 skills; none of the six
non-financial ones contained a single shell command. finance-expert
documents code that charges cards and reads bank accounts, so it now
grants no shell at all.
- Remove credential literals: Stripe keys, two JWT signing keys, an
Express session secret, a Redis password and WiFi credentials, all
inlined in examples. They load from the environment now.
- finance-expert: idempotency keys were documented but absent, so a
retry double-charged; webhook signature failures were not caught, so a
forged event raised uncaught instead of being rejected;
int(amount * 100) truncated fractions of a cent. All fixed, plus a
money-movement guardrails section.
- trading-expert: place_order routed without any pre-trade risk check
although a RiskManager sat unused in the next section. Risk validation
now runs before routing and raises rather than returning a boolean a
caller can ignore; live routing is opt-in.
- Correct an Ansible Vault example that showed plaintext under an
"encrypted" label.
Also fixes 8 broken documentation links and a prematurely closed code
fence in skill-creator-expert that leaked template content into prose.
Per the repository file-organization policy, four stale progress reports
(SKILLS_MANIFEST, COMPLETE_SKILLS_LIBRARY, COMPLETE_LIBRARY_MANIFEST,
PHASE_3_DATA_ANALYTICS) move out of stdlib/ into the gitignored
.roadmap/status/stdlib/; they claimed 31 of 100 skills complete. They
appear here as deletions because .roadmap/ is not tracked.
Reviewed-by: Security Analyst, Language Designer, DevX Engineer,
Documentation Specialist
* fix(skills): resolve standard library skills from their real layout
No stdlib skill was resolvable. SkillResolver looked for
`<stdlibDir>/<name>.md` with stdlibDir defaulting to `stdlib/skills`, a
directory that does not exist, and the path ignored the category level
the library actually uses. The two LSP providers had the same wrong
directory and scanned only one level deep, so neither completion nor
go-to-definition could see a skill either.
- skill-discovery.ts: enumerate skill entry points across the shapes in
use - a flat `<name>.md`, `<name>/SKILL.md`, and
`<category>/<name>/SKILL.md` - while skipping references/, scripts/
and assets/, which hold supporting material rather than entry points.
- skill-resolver.ts: point stdlibDir at `stdlib`, and look the name up
as a directory under any category as well as the two legacy shapes, so
existing custom stdlib directories keep working. The name is used as a
single path segment and rejected if it contains a separator or
traversal, so a reference cannot escape the stdlib root.
- Rewire both LSP providers onto the shared discovery helper.
Tests: 13 new cases covering the layouts, ordering, the references/
exclusion, path-traversal rejection, and an integration test that
resolves real shipped skills by bare name.
Reviewed-by: Compiler Engineer, Runtime Architect, Security Analyst
* feat(stdlib): add 17 skills covering the library's largest gaps
Selection was driven by cross-referencing coverage against observed usage
rather than by intuition: Stack Overflow and GitHub Octoverse data for
which technologies matter, and install rankings on public agent-skill
registries for the shape of skills people actually use.
That comparison found a mismatch of form, not only of coverage. The
most-installed skills in the ecosystem are procedures - tdd, refactoring,
frontend design, browser automation - while all 174 existing skills were
domain knowledge shaped as <domain>-expert. The new workflows/ category
closes that gap and introduces the <activity>-workflow convention.
New category workflows/ (4)
- tdd-workflow, refactoring-workflow, debugging-workflow,
code-review-workflow. code-review-workflow complements rather than
replaces code-review-expert: procedure versus judgement. Merge them if
the split proves confusing in use.
Applied AI (3) - the largest coverage gap
- llm-engineering-expert, rag-expert, agent-engineering-expert.
The library referenced LLMs in tags but covered none of it: pgvector
appeared zero times across 174 skills, LangChain once, MCP twice
despite the repository shipping an MCP integration guide.
Capabilities (2)
- document-processing-expert (PDF, DOCX, XLSX, PPTX in one skill),
browser-automation-expert (a client against third-party sites,
distinct from playwright-expert which tests your own application).
Data (3)
- mysql-expert, the second most used database and previously absent
while rarer stores had skills; analytical-databases-expert;
stream-processing-expert.
Security (3)
- secrets-management-expert, supply-chain-security-expert (OWASP A03
2025), identity-access-expert (OWASP A01).
Interface and meta (2)
- accessibility-expert: design/ held only design-expert, which despite
its name covers software architecture, so WCAG had no home.
- skill-router: find and compose skills across 191, with a
disambiguation table for overlapping pairs.
Grouping by decision context rather than by technology keeps the growth
to 17 skills for roughly 50 topics. Five vector stores live inside
rag-expert; four document formats inside document-processing-expert.
Per-tool depth sits in references/, which the progressive-disclosure work
in 3.0.0 made cheap.
Four further gaps are better served by extending existing skills -
PyTorch and TensorFlow in ml-expert, OpenTelemetry in monitoring-expert,
Pulumi and Crossplane in terraform-expert - and are not in this change.
Library 3.0.0 -> 3.1.0, additive only. Adds the workflows label to the
inventory generator; catalogue, inventory, structure and CHANGELOG
regenerated.
Reviewed-by: Product Strategist, Security Analyst, DevX Engineer,
Documentation Specialist
* fix(test): create test directories with mkdtempSync
CodeQL flagged js/insecure-temporary-file (CWE-377) on both suites.
`join(tmpdir(), <predictable name>)` followed by mkdirSync creates a
world-readable directory at a guessable path, so another local user can
pre-create it or plant a symlink between the name being computed and the
directory being created.
mkdtempSync creates the directory atomically with a random suffix and
0700 permissions, which closes both the disclosure and the race.
One occurrence is new in this branch (skill-discovery); the other
pre-dates it in skill-resolver and is fixed in the same pass rather than
left as a known finding in a file this branch already touches.
12 KiB
name, version, description, category, tags, allowed-tools, metadata
| name | version | description | category | tags | allowed-tools | metadata | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| supply-chain-security-expert | 1.0.0 | Secure the path from dependency to deployed artefact: SBOMs, dependency scanning, build provenance, artefact signing and CI/CD integrity. Use when the user mentions supply chain security, SBOM, CycloneDX or SPDX, SCA or dependency scanning, Sigstore or cosign, SLSA, provenance and attestation, a compromised or typosquatted package, or when the task involves hardening a build pipeline or answering a vendor security questionnaire about dependencies. | security |
|
|
|
Supply Chain Security Expert
Most of what ships is code nobody on the team wrote. OWASP ranks software supply chain failures among the highest-impact categories in the 2025 Top 10, and EU regulation (NIS2, and the Cyber Resilience Act) now makes dependency management a compliance obligation rather than an engineering preference.
Core Concepts
The Attack Surface
| Vector | Example | Primary control |
|---|---|---|
| Malicious package | Typosquat, or a maintainer account takeover | Pinning, provenance, install-script review |
| Compromised dependency | Legitimate package backdoored in a release | SBOM plus continuous scanning |
| Dependency confusion | Internal package name resolved from a public registry | Scoped registries, explicit source pinning |
| Build system compromise | CI injects code into the artefact | Hermetic builds, provenance attestation |
| Artefact tampering | Registry image replaced after publication | Signing, digest pinning, admission policy |
| Credential theft in CI | A leaked token publishes a malicious release | OIDC federation, least-privilege tokens |
Know What You Ship
You cannot patch what you cannot enumerate. An SBOM is the inventory — generated at build time from what actually went in, not written by hand.
Provenance Is Stronger Than Scanning
Scanning tells you about known vulnerabilities. Provenance tells you that this artefact was built from this commit by that pipeline. When a new advisory lands, scanning finds it; when a build system is compromised, only provenance does.
SBOM
Generate at build time, store as a build artefact, attach to the release.
# From a container image, a filesystem, or a lockfile
syft packages ghcr.io/acme/api:1.4.2 -o cyclonedx-json > sbom.cdx.json
syft packages dir:. -o spdx-json > sbom.spdx.json
# Scan the SBOM rather than re-resolving dependencies
grype sbom:sbom.cdx.json --fail-on high
osv-scanner --sbom sbom.cdx.json
CycloneDX suits security use; SPDX suits licence compliance. Producing both costs one extra command.
An SBOM is only useful if it is queryable when an advisory lands:
# "Are we affected by the log4j-style advisory in package X?"
jq -r '.components[] | select(.name == "log4j-core") | "\(.name)@\(.version)"' sbom.cdx.json
Store SBOMs per release, indexed by artefact digest, retained as long as the artefact runs anywhere. The question always arrives after the release.
Dependency Hygiene
Pin, and pin transitively
npm ci # lockfile only; fails if package.json disagrees
pip install --require-hashes -r requirements.txt
cargo build --locked
go mod verify
npm install in CI can resolve differently from local. npm ci cannot — it is
the difference between a reproducible build and a hope.
# requirements.txt with hashes: the registry cannot substitute content
cryptography==43.0.1 \
--hash=sha256:8d09d05439ce7baa8e9e95b07ec5b6c886f548deb7e0f69ef25f64b3bce842f2
Review what you add
Before a new direct dependency: is it maintained, does it have more than one maintainer, what does it pull in transitively, what licence, and does it run install scripts?
npm view <pkg> maintainers time.modified
npm ls <pkg> --all # who actually depends on it
npx license-checker --summary
docker run --rm -v "$PWD:/src" aquasec/trivy fs --scanners vuln,license /src
Disable install scripts by default and allow them explicitly:
# .npmrc
ignore-scripts=true
Most package-manager compromises execute at install time. This one line removes that class.
Prevent dependency confusion
# .npmrc — internal scope resolves only from the internal registry
@acme:registry=https://npm.internal.acme.com/
//npm.internal.acme.com/:_authToken=${NPM_TOKEN}
# pip.conf — never mix; --extra-index-url silently prefers the highest version
[global]
index-url = https://pypi.internal.acme.com/simple
--extra-index-url pointing at both an internal and the public index is the
dependency confusion vulnerability, not a mitigation: pip picks the highest
version wherever it lives.
Vulnerability Management
Scanning produces more findings than anyone can fix. Triage by exploitability, not by CVSS alone.
osv-scanner --lockfile package-lock.json --lockfile requirements.txt
grype ghcr.io/acme/api:1.4.2 --fail-on critical --only-fixed
trivy image --severity HIGH,CRITICAL --ignore-unfixed ghcr.io/acme/api:1.4.2
Triage questions, in order:
- Is the vulnerable code path reachable from our application? Reachability analysis eliminates the majority of findings.
- Is it exploitable in our deployment — is that parser fed untrusted input?
- Is a fix available?
--only-fixedseparates actionable from noise. - What is the exposure — internet-facing, or an internal batch job?
Record the decision. A VEX document states, machine-readably, that a component is present but not affected:
{
"bomFormat": "CycloneDX",
"specVersion": "1.6",
"vulnerabilities": [
{
"id": "CVE-2026-12345",
"analysis": {
"state": "not_affected",
"justification": "vulnerable_code_not_in_execute_path",
"detail": "XML parsing is not reached; we use the JSON codec exclusively."
}
}
]
}
Without VEX, the same finding is re-triaged by every scanner run and every customer questionnaire.
Build Integrity
SLSA describes build integrity in levels. The useful progression:
| Level | Requirement | Practical step |
|---|---|---|
| 1 | Provenance exists | Emit build metadata |
| 2 | Signed provenance from a hosted builder | GitHub Actions attestations |
| 3 | Hardened, isolated builds | Reusable trusted workflow, no self-hosted runner reuse |
name: release
on:
push:
tags: ['v*']
permissions:
contents: read
id-token: write # OIDC: no long-lived registry credentials
attestations: write
packages: write
jobs:
build:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- name: Build and push
id: push
run: |
docker build -t "$IMAGE:$GITHUB_REF_NAME" .
docker push "$IMAGE:$GITHUB_REF_NAME"
echo "digest=$(docker inspect --format='{{index .RepoDigests 0}}' "$IMAGE:$GITHUB_REF_NAME")" >> "$GITHUB_OUTPUT"
- uses: actions/attest-build-provenance@v2
with:
subject-name: ${{ env.IMAGE }}
subject-digest: ${{ steps.push.outputs.digest }}
push-to-registry: true
- name: Generate and attach SBOM
run: |
syft "$IMAGE@${{ steps.push.outputs.digest }}" -o cyclonedx-json > sbom.cdx.json
cosign attest --predicate sbom.cdx.json --type cyclonedx \
"$IMAGE@${{ steps.push.outputs.digest }}"
Pin actions to a commit SHA, not a tag. A tag is mutable: @v4 can be moved
to point at anything, and that has been used in real attacks.
Signing and Verification
Signing that is never verified provides nothing. The verification step is the control.
# Keyless signing: identity from the OIDC token, recorded in a public transparency log
cosign sign --yes ghcr.io/acme/api@sha256:abc123...
# Verification, bound to the workflow that is allowed to build this
cosign verify ghcr.io/acme/api@sha256:abc123... \
--certificate-identity-regexp="^https://github.com/acme/api/.github/workflows/release.yml@refs/tags/v" \
--certificate-oidc-issuer=https://token.actions.githubusercontent.com
The identity constraints are the security. cosign verify without them confirms
only that somebody signed it.
Enforce at admission, so an unsigned image cannot run:
apiVersion: kyverno.io/v1
kind: ClusterPolicy
metadata:
name: require-signed-images
spec:
validationFailureAction: Enforce
rules:
- name: verify-signature
match:
any: [{ resources: { kinds: [Pod] } }]
verifyImages:
- imageReferences: ['ghcr.io/acme/*']
attestors:
- entries:
- keyless:
subject: 'https://github.com/acme/*/.github/workflows/release.yml@refs/tags/*'
issuer: 'https://token.actions.githubusercontent.com'
CI/CD Hardening
- Least-privilege tokens. Default
permissions: {}at the workflow level and grant per job. - No long-lived cloud keys. OIDC federation instead.
- Never run untrusted code with secrets in scope.
pull_request_targetwith a checkout of the fork's head is a well-known privilege escalation. - Pin actions and base images by digest.
- Separate build from deploy credentials. A compromised build job should not be able to deploy.
- Protect the release branch: required reviews, no force push, signed commits.
- Log and retain build metadata — who triggered it, from which commit.
Best Practices
- Generate an SBOM for every build, retained with the artefact.
- Scan continuously, not only at build. New advisories apply to artefacts already released.
- Fail the build on new critical findings, and allow documented exceptions with an expiry date.
- Automate dependency updates (Renovate, Dependabot) with grouped PRs and a cooldown before adopting a brand-new release.
- Keep an inventory of what runs where, so an advisory maps to deployments in minutes rather than days.
- Prefer fewer dependencies. Every one is a trust decision and a maintenance obligation.
Anti-Patterns
- Floating versions (
^1.2.3,latest) in production builds. npm installin CI instead ofnpm ci.- Tag-pinned actions and base images — mutable references.
- Signing without verifying.
- Scanning only at build time.
- Ignoring transitive dependencies — most vulnerable code is transitive.
--extra-index-urlmixing internal and public registries.- An SBOM generated once for an audit and never again.
- Blanket suppression of findings with no justification or expiry.
Reference Documentation
- Response Playbook — responding to a compromised dependency, incident triage, VEX authoring, and regulatory obligations