Files
Jose Montes de Oca fc2810eea7 ci: run the skill conformance gate on every pull request (#171)
The gate is about to become a required status check on main. A required
check that is path-filtered never reports on a pull request outside the
filter, and that pull request then waits forever on a check that will
never arrive. The suites read Markdown off disk with no build step, no
model key, and no network, so running them unconditionally costs well
under a minute.
2026-09-01 11:08:47 -04:00

49 lines
1.3 KiB
YAML

name: CI - Skill conformance
# Runs the OpenProse conformance suites under tests/open-prose/**. The suites
# read Markdown off disk and make string assertions: no build step, no model
# key, no network, well under a minute.
#
# There is deliberately no path filter. This job is the required status check
# on main, and a required check that never reports leaves a pull request
# waiting on it forever — so every pull request runs it, whatever it touches.
on:
pull_request:
push:
branches: [main]
concurrency:
group: ci-skill-${{ github.head_ref || github.ref }}
cancel-in-progress: true
permissions:
contents: read
jobs:
skill:
# NOTE: this job name is the required status check on main — do not rename.
name: CI - Skill conformance
runs-on: ubuntu-latest
timeout-minutes: 10
steps:
- name: Checkout
uses: actions/checkout@v4
- name: Setup pnpm
uses: pnpm/action-setup@b906affcce14559ad1aafd4ab0e942779e9f58b1 # v4.3.0
- name: Setup Node.js
uses: actions/setup-node@v4
with:
node-version: 22
cache: "pnpm"
cache-dependency-path: "pnpm-lock.yaml"
- name: Install dependencies
run: pnpm install --frozen-lockfile
- name: Skill conformance suites
run: pnpm test:skill