skills/proffesor-for-testing__agentic-qe

mirror of https://github.com/proffesor-for-testing/agentic-qe.git synced 2026-09-19 08:45:47 +08:00

Files

T

Profa 2253d05618 feat: flatten project structure — archive v2, promote v3 to root

Remove the nested v3/ subdirectory by moving all active source code,
tests, configs, and assets directly to the project root. Archive v2/
(dead code, 847MB) to v2-archive.tar.gz.

Key changes:
- Move v3/src/ → src/, v3/tests/ → tests/, v3/packages/ → packages/
- Move v3/tsconfig.json, v3/vitest.config.ts to root
- Merge v3/package.json into root package.json (ESM, scripts, deps, exports)
- Merge v3/scripts/ into scripts/, v3/implementation/ into docs/implementation/
- Update all CI workflows to remove "cd v3 &&" and v3/ path prefixes
- Fix all init installer path resolution (3-level-up → 2-level-up)
- Fix hooks to use "node ./dist/cli/bundle.js" instead of bare "aqe"
- Update settings.json ADR/DDD directories to docs/implementation/
- Fix helper scripts (statusline, adr-compliance, ddd-tracker, guidance-hooks)
- Update 58 agent definitions: aqe/v3/ → aqe/ memory namespaces
- Update 15 guidance shards: v3/src/ → src/ path references
- Fix sync interfaces: remove v3/ and v2/ path references
- Fix test path calculations (process.cwd() + '..' no longer needed)
- Fix flaky perf test threshold (500ms → 1000ms for CI environments)
- Fix complexity-analyzer test to match ADR-051 keyword-based eligibility

Build passes, 17,901 tests pass, CLI and MCP bundles verified.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-01 11:35:41 +00:00

37 KiB

Raw Permalink Blame History

Agentic QE v3: Complete Reimagining with DDD Architecture

Executive Summary

Agentic QE v3 represents a complete architectural overhaul that transforms the quality engineering framework from monolithic services to Domain-Driven Design bounded contexts, with AI-first test generation, sublinear coverage analysis, intelligent quality gates, and comprehensive code intelligence.

Key Objectives

Objective	Target	Impact
Architecture	12 DDD bounded contexts	Clear boundaries, independent evolution
Agents	47 specialized agents	Complete QE coverage
Performance	O(log n) coverage analysis	100x-12,500x faster at scale
AI Quality	>80% valid generated tests	Higher quality, less manual work
Learning	15% improvement per sprint	Continuous improvement
Coverage	>90% with risk weighting	Better defect prevention
Feedback	<5 minute QE cycle	Faster developer feedback
Knowledge Graph	Semantic code search	Intelligent test targeting

Timeline Overview

Phase 1 (Weeks 1-4): Foundation & DDD Setup
Phase 2 (Weeks 5-12): Core Domain Implementation (12 domains)
Phase 3 (Weeks 13-18): Integration & Optimization
Phase 4 (Weeks 19-24): Testing & Release

Target Release: v3.0.0

Current State Analysis
DDD Architecture Design
Domain Implementation
Agent Coordination
Learning System
Backward Compatibility
Implementation Roadmap
Success Metrics

1. Current State Analysis

1.1 Codebase Overview

Agentic QE v2.8.x
├── Source Files: ~200 TypeScript files
├── Core Agents: 22 QE agents + 15 n8n agents + 11 subagents
├── Skills: 46 QE skills
├── MCP Tools: 25+ tools
└── Architecture: Flat structure, some coupling

1.2 Architectural Strengths (Preserve)

Comprehensive agent ecosystem (48 agents)
Strong MCP integration
AgentDB memory with HNSW indexing (150x-12,500x faster)
Sublinear coverage analysis (O(log n))
Multi-framework test support
Code Intelligence with Knowledge Graph

1.3 Areas for Improvement

Issue	Current	v3 Solution
Flat structure	All tools in `src/mcp/tools/`	12 DDD bounded contexts
Tight coupling	Direct service dependencies	Event-driven communication
Limited learning	Per-agent learning	Unified learning system
Basic quality gates	Threshold checks	ML-based decisions
Manual coordination	Developer orchestrates agents	Hierarchical auto-coordination
Missing domains	No formal requirements validation	6 new domains

2. DDD Architecture Design

2.1 Bounded Context Map (12 Domains)

┌─────────────────────────────────────────────────────────────────────────────────┐
│                        AGENTIC QE V3 ARCHITECTURE (12 DOMAINS)                   │
├─────────────────────────────────────────────────────────────────────────────────┤
│                                                                                  │
│  ┌────────────────────────────────────────────────────────────────────────────┐ │
│  │                         PRESENTATION LAYER                                  │ │
│  │  ┌─────────┐  ┌─────────┐  ┌─────────┐  ┌─────────┐  ┌─────────┐          │ │
│  │  │   CLI   │  │   MCP   │  │   API   │  │  Hooks  │  │ WebUI   │          │ │
│  │  │Commands │  │  Tools  │  │Endpoints│  │(17 total│  │Dashboard│          │ │
│  │  └─────────┘  └─────────┘  └─────────┘  └─────────┘  └─────────┘          │ │
│  └────────────────────────────────────────────────────────────────────────────┘ │
│                                      │                                           │
│  ┌────────────────────────────────────────────────────────────────────────────┐ │
│  │                         APPLICATION LAYER                                   │ │
│  │  ┌───────────────────────────────────────────────────────────────────────┐ │ │
│  │  │                    QE KERNEL (Microkernel)                             │ │ │
│  │  │  • Domain Registry (12)  • Plugin Loader  • Event Bus  • Coordinator   │ │ │
│  │  │  • Max 15 Concurrent Agents  • Hybrid Memory (SQLite + AgentDB)        │ │ │
│  │  └───────────────────────────────────────────────────────────────────────┘ │ │
│  └────────────────────────────────────────────────────────────────────────────┘ │
│                                      │                                           │
│  ┌────────────────────────────────────────────────────────────────────────────┐ │
│  │                         DOMAIN LAYER (12 Bounded Contexts)                  │ │
│  │                                                                             │ │
│  │  ROW 1: CORE TESTING DOMAINS                                                │ │
│  │  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐        │ │
│  │  │    TEST     │  │    TEST     │  │  COVERAGE   │  │   QUALITY   │        │ │
│  │  │ GENERATION  │  │  EXECUTION  │  │  ANALYSIS   │  │ ASSESSMENT  │        │ │
│  │  │   (5 agts)  │  │   (4 agts)  │  │   (4 agts)  │  │   (4 agts)  │        │ │
│  │  │ • AI Gen    │  │ • Parallel  │  │ • O(log n)  │  │ • Gates     │        │ │
│  │  │ • TDD       │  │ • Retry     │  │ • Risk      │  │ • Metrics   │        │ │
│  │  │ • Property  │  │ • Flaky     │  │ • Gaps HNSW │  │ • Deploy    │        │ │
│  │  └─────────────┘  └─────────────┘  └─────────────┘  └─────────────┘        │ │
│  │                                                                             │ │
│  │  ROW 2: INTELLIGENCE DOMAINS                                                │ │
│  │  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐        │ │
│  │  │   DEFECT    │  │ REQUIREMENTS│  │    CODE     │  │  SECURITY   │        │ │
│  │  │INTELLIGENCE │  │ VALIDATION  │  │INTELLIGENCE │  │ COMPLIANCE  │        │ │
│  │  │   (4 agts)  │  │   (4 agts)  │  │   (4 agts)  │  │   (4 agts)  │        │ │
│  │  │ • Predict   │  │ • BDD Gen   │  │ • KG Build  │  │ • SAST/DAST │        │ │
│  │  │ • RCA       │  │ • Testabil. │  │ • Semantic  │  │ • Compliance│        │ │
│  │  │ • Regress.  │  │ • AC Valid  │  │ • Impact    │  │ • CVE Track │        │ │
│  │  └─────────────┘  └─────────────┘  └─────────────┘  └─────────────┘        │ │
│  │                                                                             │ │
│  │  ROW 3: SPECIALIZED DOMAINS                                                 │ │
│  │  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐        │ │
│  │  │  CONTRACT   │  │   VISUAL    │  │   CHAOS     │  │  LEARNING   │        │ │
│  │  │  TESTING    │  │ACCESSIBILITY│  │ RESILIENCE  │  │OPTIMIZATION │        │ │
│  │  │   (4 agts)  │  │   (4 agts)  │  │   (4 agts)  │  │   (5 agts)  │        │ │
│  │  │ • API Contr │  │ • Visual Reg│  │ • Chaos Eng │  │ • Patterns  │        │ │
│  │  │ • Schema    │  │ • A11y      │  │ • Load Test │  │ • Transfer  │        │ │
│  │  │ • GraphQL   │  │ • Responsive│  │ • Resilience│  │ • Prod Intel│        │ │
│  │  └─────────────┘  └─────────────┘  └─────────────┘  └─────────────┘        │ │
│  │                                                                             │ │
│  └────────────────────────────────────────────────────────────────────────────┘ │
│                                      │                                           │
│  ┌────────────────────────────────────────────────────────────────────────────┐ │
│  │                        INFRASTRUCTURE LAYER                                 │ │
│  │  ┌─────────┐  ┌─────────┐  ┌─────────┐  ┌─────────┐  ┌─────────┐          │ │
│  │  │ AgentDB │  │ SQLite  │  │AI Models│  │   Git   │  │ RuVector│          │ │
│  │  │  HNSW   │  │         │  │(Claude) │  │         │  │CodeIntel│          │ │
│  │  └─────────┘  └─────────┘  └─────────┘  └─────────┘  └─────────┘          │ │
│  └────────────────────────────────────────────────────────────────────────────┘ │
│                                                                                  │
└─────────────────────────────────────────────────────────────────────────────────┘

2.2 Domain Event Flow

                          ┌─────────────────────────────────────┐
                          │           EVENT BUS                  │
                          │    (Domain Event Router)             │
                          └──────────────┬──────────────────────┘
                                         │
        ┌────────────────────────────────┼────────────────────────────────┐
        │                                │                                │
        ▼                                ▼                                ▼
┌───────────────┐                ┌───────────────┐                ┌───────────────┐
│Test Generation│                │Code Intelligence              │Quality Gates  │
│    Events     │                │    Events     │                │    Events     │
├───────────────┤                ├───────────────┤                ├───────────────┤
│TestCreated    │──────────────▶│KGIndexRequest │──────────────▶│GateEvaluate   │
│SuiteComplete  │                │ImpactAnalysis │                │DeployApproved │
│PatternLearned │                │DependencyMap  │                │DeployBlocked  │
└───────────────┘                └───────────────┘                └───────────────┘
        │                                │                                │
        ▼                                ▼                                ▼
┌───────────────┐                ┌───────────────┐                ┌───────────────┐
│  Coverage     │                │   Defect      │                │   Learning    │
│   Events      │                │   Events      │                │    Events     │
├───────────────┤                ├───────────────┤                ├───────────────┤
│GapDetected    │◀──────────────│DefectPredicted│◀──────────────│PatternConsolid│
│RiskIdentified │                │RCACompleted   │                │TransferDone   │
│CoverageReport │                │RegressionRisk │                │Optimization   │
└───────────────┘                └───────────────┘                └───────────────┘

3. Domain Implementation

3.1 Test Generation Domain (5 agents)

Purpose: AI-powered test creation with pattern learning

Agents:

v3-qe-test-architect - Strategic test planning
v3-qe-tdd-specialist - TDD red-green-refactor
v3-qe-integration-tester - Integration test creation
v3-qe-property-tester - Property-based testing
v3-qe-test-data-architect - Test data generation

Events: TestCaseGeneratedEvent, TestSuiteCreatedEvent, PatternLearnedEvent

3.2 Test Execution Domain (4 agents)

Purpose: Parallel test execution with intelligent retry

Agents:

v3-qe-parallel-executor - Distributed test execution
v3-qe-flaky-hunter - Flaky test detection
v3-qe-retry-handler - Intelligent retry logic
v3-qe-execution-optimizer - Execution optimization

Events: TestRunStartedEvent, TestRunCompletedEvent, FlakyTestDetectedEvent

3.3 Coverage Analysis Domain (4 agents)

Purpose: O(log n) coverage gap detection with HNSW

Agents:

v3-qe-coverage-specialist - Coverage metrics
v3-qe-gap-detector - HNSW-based gap detection
v3-qe-risk-scorer - Risk-weighted coverage
v3-qe-mutation-tester - Mutation testing

Events: CoverageReportCreatedEvent, CoverageGapDetectedEvent, RiskZoneIdentifiedEvent

3.4 Quality Assessment Domain (4 agents)

Purpose: Intelligent quality gate decisions

Agents:

v3-qe-quality-gate - Quality gate evaluation
v3-qe-quality-analyzer - Metrics analysis
v3-qe-deployment-advisor - Deployment readiness
v3-qe-code-complexity - Code complexity analysis

Events: QualityGateEvaluatedEvent, DeploymentApprovedEvent, DeploymentBlockedEvent

3.5 Defect Intelligence Domain (4 agents)

Purpose: Defect prediction, root cause analysis, regression risk

Agents:

v3-qe-defect-predictor - ML-based prediction
v3-qe-pattern-learner - Pattern recognition
v3-qe-root-cause-analyzer - Root cause analysis
v3-qe-regression-analyzer - Regression risk analysis ⭐ NEW

Events: DefectPredictedEvent, RootCauseIdentifiedEvent, RegressionRiskAnalyzedEvent

3.6 Requirements Validation Domain (4 agents) ⭐ NEW

Purpose: Requirements analysis and testability validation before development

Agents:

v3-qe-requirements-validator - Requirements validation
v3-qe-bdd-scenario-writer - BDD scenario generation
v3-qe-testability-scorer - Testability analysis
v3-qe-acceptance-criteria - AC validation

Events: RequirementAnalyzedEvent, BDDScenariosGeneratedEvent, TestabilityScored

3.7 Code Intelligence Domain (4 agents) ⭐ NEW

Purpose: Knowledge Graph, semantic code understanding, impact analysis

Agents:

v3-qe-code-intelligence - Knowledge Graph builder
v3-qe-semantic-analyzer - Semantic code analysis
v3-qe-dependency-mapper - Dependency analysis
v3-qe-impact-analyzer - Change impact analysis

Events: KnowledgeGraphUpdatedEvent, ImpactAnalysisCompletedEvent, SemanticSearchCompleted

3.8 Security & Compliance Domain (4 agents) ⭐ EXPANDED

Purpose: Security scanning and regulatory compliance

Agents:

v3-qe-security-scanner - SAST/DAST scanning
v3-qe-security-auditor - Security audit
v3-qe-compliance-validator - Regulatory compliance (GDPR, HIPAA, SOC2)
v3-qe-vulnerability-tracker - CVE tracking

Events: VulnerabilityDetectedEvent, ComplianceValidatedEvent, SecurityAuditCompleted

3.9 Contract & API Testing Domain (4 agents) ⭐ NEW

Purpose: API contract validation and compatibility testing

Agents:

v3-qe-contract-validator - Contract testing (Pact)
v3-qe-api-compatibility - API compatibility checking
v3-qe-schema-validator - Schema validation
v3-qe-graphql-tester - GraphQL testing

Events: ContractViolationDetectedEvent, SchemaValidatedEvent, APICompatibilityChecked

3.10 Visual & Accessibility Domain (4 agents) ⭐ NEW

Purpose: Visual regression testing and accessibility compliance

Agents:

v3-qe-visual-tester - Visual regression testing
v3-qe-a11y-specialist - Accessibility testing (WCAG 2.2)
v3-qe-responsive-tester - Responsive design testing
v3-qe-screenshot-differ - Screenshot comparison

Events: VisualRegressionDetectedEvent, AccessibilityIssueFoundEvent, ScreenshotBaselineUpdated

3.11 Chaos & Resilience Domain (4 agents) ⭐ NEW

Purpose: Chaos engineering and resilience testing

Agents:

v3-qe-chaos-engineer - Chaos engineering
v3-qe-resilience-tester - Resilience validation
v3-qe-load-tester - Load/stress testing
v3-qe-performance-profiler - Performance profiling

Events: ChaosExperimentCompletedEvent, ResilienceValidatedEvent, PerformanceBottleneckFound

3.12 Learning Optimization Domain (5 agents)

Purpose: Cross-domain learning and continuous improvement

Agents:

v3-qe-learning-coordinator - Learning orchestration
v3-qe-transfer-specialist - Knowledge transfer
v3-qe-metrics-optimizer - Metrics optimization
v3-qe-production-intel - Production intelligence
v3-qe-knowledge-manager - Knowledge management

Events: PatternConsolidatedEvent, TransferCompletedEvent, OptimizationAppliedEvent

4. Agent Coordination

4.1 Hierarchical Structure (47 Agents)

QUEEN COORDINATOR (Agent #1)
│
├── TEST GENERATION GROUP (5 Agents)
│   ├── v3-qe-test-architect
│   ├── v3-qe-tdd-specialist
│   ├── v3-qe-integration-tester
│   ├── v3-qe-property-tester
│   └── v3-qe-test-data-architect
│
├── TEST EXECUTION GROUP (4 Agents)
│   ├── v3-qe-parallel-executor
│   ├── v3-qe-flaky-hunter
│   ├── v3-qe-retry-handler
│   └── v3-qe-execution-optimizer
│
├── COVERAGE ANALYSIS GROUP (4 Agents)
│   ├── v3-qe-coverage-specialist
│   ├── v3-qe-gap-detector
│   ├── v3-qe-risk-scorer
│   └── v3-qe-mutation-tester
│
├── QUALITY ASSESSMENT GROUP (4 Agents)
│   ├── v3-qe-quality-gate
│   ├── v3-qe-quality-analyzer
│   ├── v3-qe-deployment-advisor
│   └── v3-qe-code-complexity
│
├── DEFECT INTELLIGENCE GROUP (4 Agents)
│   ├── v3-qe-defect-predictor
│   ├── v3-qe-pattern-learner
│   ├── v3-qe-root-cause-analyzer
│   └── v3-qe-regression-analyzer
│
├── REQUIREMENTS VALIDATION GROUP (4 Agents) ⭐ NEW
│   ├── v3-qe-requirements-validator
│   ├── v3-qe-bdd-scenario-writer
│   ├── v3-qe-testability-scorer
│   └── v3-qe-acceptance-criteria
│
├── CODE INTELLIGENCE GROUP (4 Agents) ⭐ NEW
│   ├── v3-qe-code-intelligence
│   ├── v3-qe-semantic-analyzer
│   ├── v3-qe-dependency-mapper
│   └── v3-qe-impact-analyzer
│
├── SECURITY COMPLIANCE GROUP (4 Agents) ⭐ EXPANDED
│   ├── v3-qe-security-scanner
│   ├── v3-qe-security-auditor
│   ├── v3-qe-compliance-validator
│   └── v3-qe-vulnerability-tracker
│
├── CONTRACT TESTING GROUP (4 Agents) ⭐ NEW
│   ├── v3-qe-contract-validator
│   ├── v3-qe-api-compatibility
│   ├── v3-qe-schema-validator
│   └── v3-qe-graphql-tester
│
├── VISUAL ACCESSIBILITY GROUP (4 Agents) ⭐ NEW
│   ├── v3-qe-visual-tester
│   ├── v3-qe-a11y-specialist
│   ├── v3-qe-responsive-tester
│   └── v3-qe-screenshot-differ
│
├── CHAOS RESILIENCE GROUP (4 Agents) ⭐ NEW
│   ├── v3-qe-chaos-engineer
│   ├── v3-qe-resilience-tester
│   ├── v3-qe-load-tester
│   └── v3-qe-performance-profiler
│
├── LEARNING OPTIMIZATION GROUP (5 Agents)
│   ├── v3-qe-learning-coordinator
│   ├── v3-qe-transfer-specialist
│   ├── v3-qe-metrics-optimizer
│   ├── v3-qe-production-intel
│   └── v3-qe-knowledge-manager
│
├── SPECIALIZED AGENTS (2 Cross-Domain)
│   ├── v3-qe-qx-partner (Quality Experience)
│   └── v3-qe-fleet-commander (Fleet Management)
│
└── SUBAGENTS (7 Task Workers)
    ├── v3-qe-code-reviewer
    ├── v3-qe-test-writer
    ├── v3-qe-test-implementer
    ├── v3-qe-test-refactorer
    ├── v3-qe-data-generator
    ├── v3-qe-flaky-investigator
    └── v3-qe-coverage-gap-analyzer

4.2 Coordination Protocols (6 Protocols)

Protocol 1: Morning Sync

Schedule: Daily 9am or session start
Participants: All agents
Actions: Review overnight results, identify risks, prioritize work

Protocol 2: Quality Gate

Trigger: Release candidate event
Participants: Queen, Quality Gate, Coverage, Regression, Security
Actions: Aggregate metrics, evaluate, ML risk assessment, recommend

Protocol 3: Learning Consolidation

Schedule: Friday 6pm
Participants: Learning Coordinator, Transfer Specialist, Pattern Learner
Actions: Gather patterns, consolidate, update knowledge base

Protocol 4: Defect Investigation

Trigger: Test failure
Participants: Defect Predictor, RCA, Flaky Hunter, Regression
Actions: Check flakiness, analyze root cause, predict related failures

Protocol 5: Code Intelligence Index ⭐ NEW

Trigger: Code change, hourly, or manual
Participants: Code Intelligence, Semantic Analyzer, Dependency Mapper
Actions: Update KG, analyze impact, index dependencies

Protocol 6: Security Audit ⭐ NEW

Trigger: Daily 2am, dependency update, or manual
Participants: Security Scanner, Auditor, Compliance Validator
Actions: Scan vulnerabilities, audit code, validate compliance

5. Learning System

5.1 Pattern Learning Pipeline

┌─────────────────────────────────────────────────────────────────────┐
│                    LEARNING PIPELINE (12 Domains)                    │
├─────────────────────────────────────────────────────────────────────┤
│                                                                      │
│  COLLECT          ANALYZE          STORE           APPLY             │
│                                                                      │
│  ┌──────────┐    ┌──────────┐    ┌──────────┐    ┌──────────┐       │
│  │ Success  │ ─▶ │ Extract  │ ─▶ │ AgentDB  │ ─▶ │ Future   │       │
│  │ Patterns │    │ Features │    │   HNSW   │    │ Tasks    │       │
│  │ (12 dom) │    │          │    │ O(log n) │    │          │       │
│  └──────────┘    └──────────┘    └──────────┘    └──────────┘       │
│                                                                      │
│  ┌──────────┐    ┌──────────┐    ┌──────────┐    ┌──────────┐       │
│  │ Failure  │ ─▶ │  Learn   │ ─▶ │  Anti-   │ ─▶ │  Avoid   │       │
│  │ Patterns │    │  From    │    │ Patterns │    │  Repeat  │       │
│  └──────────┘    └──────────┘    └──────────┘    └──────────┘       │
│                                                                      │
│  Cross-Domain Transfer:                                              │
│  • Test patterns → Requirements validation                          │
│  • Coverage gaps → Test generation                                  │
│  • Defect patterns → Code intelligence                              │
│  • Security findings → Compliance validation                        │
│                                                                      │
└─────────────────────────────────────────────────────────────────────┘

5.2 Transfer Learning

// Cross-domain and cross-project transfer
class TransferLearningService {
  async transfer(
    sourceProject: string,
    targetProject: string,
    context: TransferContext
  ): Promise<TransferResult> {
    // 1. Get patterns from source across all 12 domains
    const patterns = await this.patternRepo.findByProject(sourceProject);

    // 2. Filter compatible patterns by domain
    const compatible = patterns.filter(p =>
      this.isCompatible(p, context) &&
      this.isDomainRelevant(p, context.targetDomains)
    );

    // 3. Adapt to target context
    const adapted = await Promise.all(
      compatible.map(p => this.adapt(p, targetProject))
    );

    // 4. Store in target project with embeddings
    await this.patternRepo.saveAllWithEmbeddings(adapted, targetProject);

    return { transferred: adapted.length, domains: context.targetDomains };
  }
}

6. Backward Compatibility

6.1 Migration Strategy

Phase 1: Dual Operation

Both v2 and v3 APIs active
v2 calls forwarded to v3 domains
No breaking changes

Phase 2: Gradual Migration

Feature by feature migration
Domain by domain activation
Clear migration guides
Deprecation warnings

Phase 3: v2 Sunset

v2 API deprecated
Migration complete
v3 only

6.2 v2 → v3 Agent Migration Map

v2 Agent	v3 Agent	Domain
qe-test-generator	v3-qe-test-architect	test-generation
qe-coverage-analyzer	v3-qe-coverage-specialist	coverage-analysis
qe-quality-gate	v3-qe-quality-gate	quality-assessment
qe-flaky-test-hunter	v3-qe-flaky-hunter	test-execution
qe-test-executor	v3-qe-parallel-executor	test-execution
qe-code-intelligence	v3-qe-code-intelligence	code-intelligence
qe-requirements-validator	v3-qe-requirements-validator	requirements-validation
qe-regression-risk-analyzer	v3-qe-regression-analyzer	defect-intelligence
qe-api-contract-validator	v3-qe-contract-validator	contract-testing
qe-visual-tester	v3-qe-visual-tester	visual-accessibility
qe-a11y-ally	v3-qe-a11y-specialist	visual-accessibility
qe-chaos-engineer	v3-qe-chaos-engineer	chaos-resilience
qe-security-scanner	v3-qe-security-scanner	security-compliance
qe-performance-tester	v3-qe-performance-profiler	chaos-resilience
qe-production-intelligence	v3-qe-production-intel	learning-optimization

7. Implementation Roadmap

Phase 1: Foundation (Weeks 1-4) ✅ COMPLETE

Week 1-2: Infrastructure

Set up v3 directory structure for 12 domains
Define domain interfaces
Create shared kernel (entities, value objects, events)
Set up event bus infrastructure

Week 3-4: Core Framework

Implement QE Kernel (microkernel)
Create plugin system
Set up dependency injection
Implement max 15 concurrent agents limit
Write foundation tests

Phase 2: Core Domains (Weeks 5-12) ✅ COMPLETE

Week 5-6: Testing Core

Test Generation domain (5 agents)
Test Execution domain (4 agents)

Week 7-8: Analysis Core

Coverage Analysis domain (4 agents)
Quality Assessment domain (4 agents)

Week 9-10: Intelligence Core

Defect Intelligence domain (4 agents)
Code Intelligence domain (4 agents) ⭐ KG Priority

Week 11-12: Specialized Domains

Requirements Validation domain (4 agents)
Security Compliance domain (4 agents)
Contract Testing domain (4 agents)
Visual Accessibility domain (4 agents)
Chaos Resilience domain (4 agents)
Learning Optimization domain (5 agents)

Phase 3: Integration (Weeks 13-18) ✅ COMPLETE

Week 13-14: Event Integration

Domain event handlers
Cross-domain workflows
Protocol implementations (6 protocols)

Week 15-16: Tool Migration

MCP tool migration
CLI command migration
Compatibility layer

Week 17-18: Agent Coordination

Queen Coordinator implementation (via coordination layer)
12 group coordinators (domain coordinators)
Work stealing algorithm (adaptive task distribution)
Subagent orchestration

Phase 4: Release (Weeks 19-24) 🟡 IN PROGRESS

Week 19-20: Testing

Integration testing (all 12 domains)
Performance benchmarks
Load testing (47 agents)

Week 21-22: Documentation

Migration guides
Domain documentation
Agent reference

Week 23-24: Release

Beta release
Bug fixes
v3.0.0 release

8. Success Metrics

Architecture Metrics

Metric	Target	Measurement
Domain isolation	100%	No cross-domain imports
Event coverage	100%	All cross-domain via events
Plugin loading	<200ms	Startup time
Code per domain	<5000 lines	LOC count
Agent migration	100%	All 22 v2 agents migrated

Performance Metrics

Metric	Target	Measurement
Coverage analysis	O(log n)	Algorithm complexity
Gap detection	<100ms	100k file codebase
KG semantic search	<100ms	O(log n) HNSW
Test generation	<30s	Per suite
Event propagation	<100ms	Cross-domain
Max concurrent agents	15	Resource limit

Quality Metrics

Metric	Target	Measurement
Generated test validity	>80%	Pass rate
Coverage improvement	>20%	From AI tests
Defect prediction accuracy	>85%	True positive rate
Quality gate accuracy	>95%	Correct decisions
Regression risk accuracy	>80%	True positive rate
Testability scoring	>70%	Requirements with score

Learning Metrics

Metric	Target	Measurement
Patterns learned	1000+/project	Pattern count
Sprint improvement	15%	Quality delta
Transfer success	>70%	Compatible patterns
False positive reduction	5%/sprint	Trend
Cross-domain transfer	>60%	Pattern reuse

Domain Coverage Metrics

Domain	Target Coverage	Priority
test-generation	100%	P0
test-execution	100%	P0
coverage-analysis	100%	P0
quality-assessment	100%	P0
defect-intelligence	100%	P0
code-intelligence	100%	P0
requirements-validation	90%	P1
security-compliance	90%	P1
contract-testing	80%	P2
visual-accessibility	80%	P2
chaos-resilience	70%	P2
learning-optimization	100%	P0

Appendix A: File Structure

agentic-qe/
├── v2/                          # Legacy v2 implementation (preserved)
├── v3/                          # New v3 implementation
│   ├── implementation/
│   │   ├── adrs/               # 18 Architecture Decision Records
│   │   ├── architecture/       # Architecture diagrams
│   │   ├── planning/           # This plan and related docs
│   │   └── agents/             # Agent specifications
│   ├── src/
│   │   ├── kernel/             # QE Kernel (microkernel)
│   │   ├── domains/            # 12 Bounded Contexts
│   │   │   ├── test-generation/
│   │   │   ├── test-execution/
│   │   │   ├── coverage-analysis/
│   │   │   ├── quality-assessment/
│   │   │   ├── defect-intelligence/
│   │   │   ├── requirements-validation/    # NEW
│   │   │   ├── code-intelligence/          # NEW
│   │   │   ├── security-compliance/        # EXPANDED
│   │   │   ├── contract-testing/           # NEW
│   │   │   ├── visual-accessibility/       # NEW
│   │   │   ├── chaos-resilience/           # NEW
│   │   │   └── learning-optimization/
│   │   ├── shared/             # Shared kernel
│   │   ├── plugins/            # Plugin implementations
│   │   ├── coordination/       # Agent coordination
│   │   └── infrastructure/     # Infrastructure adapters
│   └── tests/                  # Domain tests (12 domains)
├── .claude/
│   ├── agents/v3/              # 47 v3 agent definitions
│   │   ├── index.yaml          # Agent index (12 domains)
│   │   └── *.md                # Agent specifications
│   └── skills/v3-*/            # 9 v3 skill definitions
│       ├── v3-qe-ddd-architecture/
│       ├── v3-qe-core-implementation/
│       ├── v3-qe-memory-system/
│       ├── v3-qe-security/
│       ├── v3-qe-performance/
│       ├── v3-qe-fleet-coordination/
│       ├── v3-qe-cli/
│       ├── v3-qe-mcp/
│       └── v3-qe-integration/
└── docs/
    └── v3/                     # v3 documentation

Appendix B: Configuration

# .agentic-qe/config.yaml
v3:
  version: "3.0.0-alpha"

  # Domain configuration
  domains: 12
  enabledDomains:
    - test-generation
    - test-execution
    - coverage-analysis
    - quality-assessment
    - defect-intelligence
    - requirements-validation
    - code-intelligence
    - security-compliance
    - contract-testing
    - visual-accessibility
    - chaos-resilience
    - learning-optimization

  # Agent limits
  maxConcurrentAgents: 15
  totalAgents: 47

  # Memory configuration
  memoryBackend: hybrid  # SQLite + AgentDB
  hnswEnabled: true
  hnswConfig:
    M: 16
    efConstruction: 200
    efSearch: 100

  # Learning
  neuralLearning: true
  patternRetention: 180  # days

  # Background workers
  backgroundWorkers: 12
  hooks: 17

  # Lazy loading
  lazyLoading: true
  preloadDomains:
    - test-generation
    - coverage-analysis
    - quality-assessment

Document Maintained By: Architecture Team Last Updated: 2026-01-08 Version: 2.1.0 (Implementation Complete - Phase 4 In Progress)

37 KiB Raw Permalink Blame History

Agentic QE v3: Complete Reimagining with DDD Architecture

Executive Summary

Key Objectives

Timeline Overview

Table of Contents

1. Current State Analysis

1.1 Codebase Overview

1.2 Architectural Strengths (Preserve)

1.3 Areas for Improvement

2. DDD Architecture Design

2.1 Bounded Context Map (12 Domains)

2.2 Domain Event Flow

3. Domain Implementation

3.1 Test Generation Domain (5 agents)

3.2 Test Execution Domain (4 agents)

3.3 Coverage Analysis Domain (4 agents)

3.4 Quality Assessment Domain (4 agents)

3.5 Defect Intelligence Domain (4 agents)

3.6 Requirements Validation Domain (4 agents) ⭐ NEW

3.7 Code Intelligence Domain (4 agents) ⭐ NEW

3.8 Security & Compliance Domain (4 agents) ⭐ EXPANDED

3.9 Contract & API Testing Domain (4 agents) ⭐ NEW

3.10 Visual & Accessibility Domain (4 agents) ⭐ NEW

3.11 Chaos & Resilience Domain (4 agents) ⭐ NEW

3.12 Learning Optimization Domain (5 agents)

4. Agent Coordination

4.1 Hierarchical Structure (47 Agents)

4.2 Coordination Protocols (6 Protocols)

5. Learning System

5.1 Pattern Learning Pipeline

5.2 Transfer Learning

6. Backward Compatibility

6.1 Migration Strategy

6.2 v2 → v3 Agent Migration Map

7. Implementation Roadmap

Phase 1: Foundation (Weeks 1-4) ✅ COMPLETE

Phase 2: Core Domains (Weeks 5-12) ✅ COMPLETE

Phase 3: Integration (Weeks 13-18) ✅ COMPLETE

Phase 4: Release (Weeks 19-24) 🟡 IN PROGRESS

8. Success Metrics

Architecture Metrics

Performance Metrics

Quality Metrics

Learning Metrics

Domain Coverage Metrics

Appendix A: File Structure

Appendix B: Configuration

37 KiB

Raw Permalink Blame History