Commit Graph

2 Commits

Author SHA1 Message Date
Amaury Levé 9f531203ec Promote 4 experimental test skills to dotnet-test plugin (#634)
Move assertion-quality, test-gap-analysis, test-smell-detection, and
test-tagging from dotnet-experimental to dotnet-test. These skills have
demonstrated sufficient eval coverage, unique value beyond baseline model
capabilities, and are already integrated into the test-quality-auditor
agent pipeline.

Changes:
- Move skills and tests, dropping the exp- prefix
- Update all cross-references in skill descriptions and routing tables
- Update test-quality-auditor agent and eval scenarios
- Update CODEOWNERS for the moved paths
- Delete duplicate exp-dotnet-test-frameworks (identical to dotnet-test-frameworks)
- Fix stale exp-dotnet-test-frameworks reference in exp-test-maintainability

Skills held back for further iteration:
- exp-mock-usage-analysis: baseline model scores 5/5 on key scenarios
- exp-test-maintainability: quality gains offset by token overhead
2026-05-11 14:46:11 +02:00
Amaury Levé f46275e64e Add evaluation tests for test-migration and test-quality-auditor agents (#543)
test-migration eval (4 scenarios):
- Auto-detect MSTest v2 on VSTest and recommend migration path
- Detect xUnit v2 and route to xUnit v3 migration
- Execute targeted MSTest v2 to v3 migration
- Non-activation: decline test writing request

test-quality-auditor eval (4 scenarios):
- Comprehensive audit of weak test suite (multi-skill pipeline)
- Targeted anti-pattern review
- Assertion quality analysis
- Non-activation: decline test generation request

Includes fixture projects with intentional quality issues:
- MSTest v2 project on VSTest for migration detection
- xUnit v2 project for migration detection
- ShoppingCart test suite with anti-patterns (assertion-free, tautological,
  catch-and-swallow, Thread.Sleep, shallow assertions, missing coverage)
2026-04-17 20:29:24 +02:00