Files
cory d0129e97a3 feat(qa): publish actionable eval diagnostics (#63)
* fix(qa): generate non-null eval reports

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* feat(qa): publish per-case eval diagnostics

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix(qa): allow required project discovery

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix(qa): correct ASP trajectory assertions

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix(qa): align S3 trajectory expectation

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix(evals): accept precise clarification for missing inputs

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix(ci): isolate report validation failures

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix(evals): align ASP cases with skill guidance

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* test(evals): define ASP mutation battery

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* refactor(qa): narrow diagnostics PR scope

Remove unrelated eval and metadata changes while retaining QA workflow diagnostics and hardening.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix(qa): harden report publication

Avoid shell word splitting when iterating skills and emit only explicitly typed public report fields.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-09-10 09:27:19 -04:00

15 lines
415 B
JSON

{
"name": "agent-skills-testing",
"private": true,
"type": "module",
"description": "Shared test tooling for agent-skills evals (schema validation of evals.json).",
"scripts": {
"validate:evals": "node validate-evals.mjs",
"test": "node --test validate-evals.test.mjs lint-item-echo.test.mjs qa-eval-workflow.test.mjs"
},
"devDependencies": {
"ajv": "^8.17.1",
"glob": "^11.0.0"
}
}