mirror of
https://github.com/dotnet/skills.git
synced 2026-09-20 09:49:54 +08:00
dd37cd3bb6
Introduce Measure-SkillCoverage.ps1 under eng/skill-coverage/ that measures how much of a SKILL.md's teaching content is verified by eval.yaml test scenarios — analogous to code coverage for skill files. The script extracts testable 'coverage points' from four structural sections of a skill file (Validation checklist, Common Pitfalls, Workflow Steps, and code patterns from fenced blocks), then cross-references them against eval.yaml assertions and rubric criteria using regex matching and keyword overlap heuristics. Features: - Per-skill and aggregate (-All) analysis across all plugins - Table output with colored pass/fail and per-category percentages - JSON output for machine consumption (single object or array) - Distinguishes deterministic assertions from rubric-only coverage - MinCoverage threshold for CI gating - Tracks source line numbers for all coverage point categories