 Amaury Levé
|
00c1e82006
|
Add exp-test-tagging skill to dotnet-test-experimental (#417)
* Add exp-test-tagging skill and evaluation
Experimental skill for analyzing and tagging test suites with a
standardized trait taxonomy (positive, negative, boundary, critical-path,
smoke, regression, integration, end-to-end, performance, security,
concurrency, resilience, destructive, configuration, flaky).
Supports MSTest, xUnit, and NUnit with framework-specific attribute syntax.
Includes 5 eval scenarios: tag MSTest/xUnit/NUnit, audit-only, non-activation.
* Move exp-test-tagging to dotnet-test-experimental plugin
|
2026-03-20 15:10:58 +00:00 |
|
|
Amaury Levé
|
6489fbee39
|
Add exp-test-anti-patterns skill for test quality review (#415)
New experimental skill that detects anti-patterns and code smells in .NET
test suites. Covers assertion quality, test isolation, naming, flakiness
indicators, over-mocking, and structural problems across MSTest, xUnit,
NUnit, and TUnit.
Key features:
- 4-tier severity classification (Critical/High/Medium/Low)
- False-positive avoidance: calibrates severity honestly and recognizes
well-written tests without inventing problems
- Positive observations alongside findings
Evaluation results (3 runs, claude-opus-4.6):
- Flakiness/coupling detection: 3.0 -> 5.0 (isolated), 4.0 (plugin)
- Duplicates/magic values: 3.0 -> 5.0 (isolated), 4.7 (plugin)
- Well-written test recognition: 2.0 -> 5.0 (both modes)
- Mixed severity detection: 5.0 baseline maintained
- Overfitting score: 0.06 across all scenarios
|
2026-03-20 14:04:18 +00:00 |
|