Agentic Quality Engineering Fleet - AI-driven quality management platform Features: - 16 specialized QE agents for comprehensive testing - AI-powered test generation with 95% coverage targets - O(log n) sublinear algorithms for massive scale - Parallel test execution with intelligent orchestration - Real-time coverage analysis and gap detection - Smart quality gates with ML-driven decisions - Security scanning (SAST, DAST, dependency analysis) - Performance testing with load orchestration - Flaky test detection with automatic stabilization - API contract validation with breaking change detection - Test data generation (10,000+ records/sec) - Production intelligence (convert incidents to tests) - Chaos engineering for resilience testing - MCP integration with Claude Code - Multi-framework support (Jest, Mocha, Cypress, Playwright) Architecture: - TypeScript implementation - MCP (Model Context Protocol) integration - Claude Code agent orchestration - Event-driven agent coordination - Distributed fleet management - Cross-session memory persistence Documentation: - Complete API documentation (TypeDoc) - User guides (Getting Started, MCP Integration, Test Generation, etc.) - Architecture deep-dive - CLI reference - Contributing guidelines - MIT License Tech Stack: - TypeScript 5.3+ - Node.js 18+ - @anthropic-ai/sdk ^0.64.0 - @modelcontextprotocol/sdk ^1.18.2 - Jest for testing - Winston for logging - SQLite for persistence Project Structure: - src/ - Source code (agents, core, MCP, CLI) - tests/ - Comprehensive test suite - docs/ - Complete documentation - .claude/ - Agent definitions and commands - config/ - Configuration files 🤖 Generated with Claude Code https://claude.com/claude-code Co-Authored-By: Claude <noreply@anthropic.com>
16 KiB
MCP Integration Guide - Agentic QE with Claude Code
This guide shows how to integrate Agentic QE with Claude Code via the Model Context Protocol (MCP), enabling you to orchestrate QE agents directly from Claude Code's CLI.
What is MCP Integration?
Model Context Protocol (MCP) connects Agentic QE with Claude Code, allowing Claude to:
- Spawn and coordinate QE agents
- Execute test generation, analysis, and validation tasks
- Access real-time fleet status and metrics
- Orchestrate complex testing workflows
Prerequisites
Required
- Claude Code: Install from claude.ai/code
- Agentic QE:
npm install -g agentic-qe - Node.js: 18.0 or higher
Optional (Advanced Coordination)
- Claude Flow:
npm install -g @claude/flow
Installation & Setup
Step 1: Install Agentic QE
# Global installation (recommended)
npm install -g agentic-qe
# Or local development
git clone https://github.com/proffesor-for-testing/agentic-qe.git
cd agentic-qe
npm install
npm run build
npm link
Step 2: Add MCP Server to Claude Code
Add the Agentic QE MCP server to your Claude Code configuration:
# Using npx (recommended)
claude mcp add agentic-qe npx -y agentic-qe mcp:start
# Or using global installation
claude mcp add agentic-qe agentic-qe mcp:start
# Or for local development
claude mcp add agentic-qe node /path/to/agentic-qe/dist/mcp/start.js
Step 3: Verify MCP Connection
# Check MCP servers
claude mcp list
# You should see:
# - agentic-qe (connected)
Step 4: Initialize AQE in Your Project
cd your-project
aqe init
This creates:
.claude/agents/- 16 specialized QE agent definitions.claude/commands/- 8 AQE slash commands.agentic-qe/- Configuration directoryCLAUDE.md- Integration documentation
Using AQE from Claude Code CLI
Basic Workflow Example
# Start Claude Code in your project
cd your-project
# Ask Claude to use AQE agents
claude "Initialize AQE fleet with mesh topology and generate comprehensive tests for src/services/user-service.ts"
What happens:
- Claude Code connects to AQE MCP server
- MCP server initializes fleet with mesh topology
- Test generator agent analyzes user-service.ts
- Generates comprehensive test suite
- Returns results to Claude Code
Available MCP Tools
When Claude Code connects to AQE, it gets access to these MCP tools:
Fleet Management
mcp__agentic_qe__fleet_init- Initialize QE fleet with topologymcp__agentic_qe__fleet_status- Get fleet health and agent statusmcp__agentic_qe__agent_spawn- Spawn specialized QE agentmcp__agentic_qe__agent_list- List active agents
Test Operations
mcp__agentic_qe__test_generate- Generate test suitesmcp__agentic_qe__test_execute- Execute tests with orchestrationmcp__agentic_qe__optimize_tests- Optimize test suites (O(log n))
Quality Analysis
mcp__agentic_qe__quality_analyze- Analyze quality metricsmcp__agentic_qe__predict_defects- AI-powered defect prediction
Task Orchestration
mcp__agentic_qe__task_orchestrate- Orchestrate complex QE tasks
Real-World Use Cases
Use Case 1: Complete Test Suite Generation
Goal: Generate comprehensive tests for a new feature
claude "
Initialize AQE fleet with hierarchical topology.
Generate comprehensive test suite for src/features/payment-processing.ts including:
- Unit tests with 95% coverage
- Integration tests for payment gateway
- Edge cases (network failures, invalid cards, refunds)
- Performance tests for high-volume transactions
Execute tests and provide quality report.
"
Behind the scenes:
- MCP tool:
fleet_init→ Creates hierarchical fleet - MCP tool:
agent_spawn→ Spawns test-generator agent - MCP tool:
test_generate→ Generates test suites - MCP tool:
test_execute→ Runs tests in parallel - MCP tool:
quality_analyze→ Analyzes results
Expected output:
🚀 Fleet initialized: hierarchical topology, 8 agents
🧠 Test Generator analyzing payment-processing.ts...
📝 Generated Test Suites:
✓ Unit tests: 32 tests (97% coverage)
✓ Integration tests: 12 tests
✓ Edge cases: 18 tests
✓ Performance tests: 5 scenarios
🧪 Executing 67 tests across 4 workers...
✓ All tests passed (8.3s)
📊 Quality Report:
Coverage: 97%
Quality Score: 95/100
Risk Level: LOW
✅ Ready for deployment
Use Case 2: CI/CD Quality Gate
Goal: Validate pull request before merge
claude "
Initialize AQE fleet.
For the current PR:
1. Generate tests for changed files
2. Execute full test suite with coverage
3. Run security scan
4. Analyze code quality
5. Provide go/no-go decision with quality gate
"
Behind the scenes:
- MCP tool:
fleet_init→ Initializes fleet - MCP tool:
test_generate→ Tests for changed files - MCP tool:
test_execute→ Full test execution - MCP tool:
agent_spawn(security-scanner) → Security scan - MCP tool:
quality_analyze→ Comprehensive analysis - MCP tool:
agent_spawn(quality-gate) → Final decision
Expected output:
🚀 Fleet initialized: 12 agents active
📋 PR Analysis: feat/user-authentication
Changed files: 8
🧪 Test Results:
✓ 156 tests passed (12.4s)
Coverage: 94% (target: 95%)
🔒 Security Scan:
✓ No critical vulnerabilities
⚠ 2 medium vulnerabilities (dependencies)
📊 Quality Analysis:
Code Quality: 88/100
Complexity: Low
Maintainability: High
🚦 Quality Gate Decision: ⚠ WARNING
Recommendation: Address coverage gap in auth-service.ts
Action: Request changes
Use Case 3: Flaky Test Detection
Goal: Identify and fix flaky tests
claude "
Initialize AQE fleet.
Spawn flaky-test-hunter agent.
Analyze test suite for flaky tests by running each test 50 times.
For detected flaky tests:
- Identify root causes
- Suggest fixes
- Generate stabilized versions
"
Behind the scenes:
- MCP tool:
fleet_init→ Initializes fleet - MCP tool:
agent_spawn(flaky-test-hunter) → Specialized agent - MCP tool:
test_execute→ 50 iterations per test - Agent analyzes timing patterns, dependencies, race conditions
- Agent generates fix recommendations
Expected output:
🚀 Fleet initialized
🕵️ Flaky Test Hunter: Analyzing 234 tests...
🔍 Running stability analysis (50 iterations each)...
Progress: 234/234 tests analyzed
📊 Flaky Test Report:
FLAKY TEST 1: user-service.test.ts:42
├─ Failure rate: 12% (6/50 runs)
├─ Root cause: Race condition in async mock
├─ Pattern: Fails when test runs < 50ms
└─ Fix: Add await + flush promises
FLAKY TEST 2: api-integration.test.ts:78
├─ Failure rate: 8% (4/50 runs)
├─ Root cause: Shared test database state
├─ Pattern: Fails after cart-service tests
└─ Fix: Isolate database per test
FLAKY TEST 3: payment.test.ts:156
├─ Failure rate: 4% (2/50 runs)
├─ Root cause: Network timeout (mock server)
├─ Pattern: Fails on slow CI runners
└─ Fix: Increase timeout from 1s to 5s
✅ Generated stabilized versions in tests/stabilized/
📈 Stability Improvement:
Before: 87% reliable
After: 100% reliable (projected)
Use Case 4: Performance Testing & Optimization
Goal: Load test API and identify bottlenecks
claude "
Initialize AQE fleet.
Spawn performance-tester agent.
Load test API endpoints:
- /api/users (GET): 1000 RPS for 5 minutes
- /api/orders (POST): 500 RPS for 5 minutes
Identify performance bottlenecks.
Provide optimization recommendations.
"
Expected output:
🚀 Fleet initialized
⚡ Performance Tester: Configuring load tests...
📊 Load Test Configuration:
Duration: 5 minutes
Scenarios:
- GET /api/users: 1000 RPS (300k requests)
- POST /api/orders: 500 RPS (150k requests)
🧪 Running load tests...
GET /api/users:
├─ Requests: 300,000
├─ Success: 99.8%
├─ Avg latency: 45ms
├─ P95 latency: 120ms
├─ P99 latency: 380ms
└─ Throughput: 998 RPS
POST /api/orders:
├─ Requests: 150,000
├─ Success: 97.2%
├─ Avg latency: 230ms
├─ P95 latency: 890ms
├─ P99 latency: 2.4s ⚠
└─ Throughput: 486 RPS
🔍 Bottleneck Analysis:
CRITICAL: Database connection pool saturation
├─ Location: orders-service.ts:78
├─ Issue: Pool size (10) insufficient for load
├─ Impact: 2.8% request failures, high P99 latency
└─ Fix: Increase pool size to 50
WARNING: N+1 query in user lookup
├─ Location: orders-service.ts:124
├─ Issue: 1 query per order item (avg 4 items)
├─ Impact: 180ms added latency
└─ Fix: Use JOIN or dataloader pattern
💡 Optimization Recommendations:
1. Increase DB pool: 10 → 50 connections
Expected improvement: -60% P99 latency
2. Fix N+1 query with batch loading
Expected improvement: -78% avg latency
3. Add Redis cache for user lookups
Expected improvement: +40% throughput
Use Case 5: AI-Powered Defect Prediction
Goal: Predict which files are most likely to have bugs
claude "
Initialize AQE fleet.
Analyze recent commits and predict defect probability for all changed files.
Focus on files with >70% defect probability.
Generate additional tests for high-risk files.
"
Expected output:
🚀 Fleet initialized
🤖 Defect Prediction: Analyzing git history...
📊 Defect Probability Analysis:
HIGH RISK (>70% probability):
├─ payment-gateway.ts (87% probability)
│ ├─ Reasons: Complex logic, 12 recent changes, low test coverage
│ ├─ Historical bugs: 5 in last 3 months
│ └─ Recommendation: Add 15+ tests
├─ user-auth.ts (76% probability)
│ ├─ Reasons: Security-critical, async complexity
│ ├─ Historical bugs: 3 in last 2 months
│ └─ Recommendation: Add edge case tests
MEDIUM RISK (40-70%):
├─ order-service.ts (58%)
├─ email-sender.ts (45%)
LOW RISK (<40%):
├─ utils/logger.ts (12%)
├─ config/constants.ts (5%)
🧪 Generating additional tests for high-risk files...
✓ payment-gateway.test.ts: +18 tests
✓ user-auth.test.ts: +12 tests
📈 Risk Reduction:
Before: 2 files at HIGH risk
After: 0 files at HIGH risk
Coverage: 74% → 92%
Claude Code CLI Commands
Initialize Fleet
claude "Initialize AQE fleet with mesh topology and 20 max agents"
Generate Tests
claude "Generate comprehensive tests for src/services/ with 95% coverage target"
Run Quality Analysis
claude "Analyze code quality for current PR and provide detailed report"
Execute Test Suite
claude "Execute all tests with parallel workers and generate coverage report"
Orchestrate Complex Workflow
claude "
1. Generate tests for changed files in current PR
2. Execute full test suite with coverage
3. Run security scan
4. Analyze performance impact
5. Provide comprehensive quality gate decision
"
MCP Tools Reference
Fleet Management
fleet_init
{
topology: "hierarchical" | "mesh" | "ring" | "star",
maxAgents: number, // default: 50
config: {
environments: string[], // ["node", "browser"]
frameworks: string[], // ["jest", "mocha", "cypress"]
testingFocus: string[] // ["unit", "integration", "e2e"]
}
}
agent_spawn
{
type: "test-generator" | "coverage-analyzer" | "quality-gate" | ...,
capabilities: string[], // ["jest", "typescript", "async"]
fleetId?: string
}
Test Operations
test_generate
{
spec: {
type: "unit" | "integration" | "e2e",
sourceCode: {
repositoryUrl: string,
language: string,
testPatterns: string[] // ["**/*.ts"]
},
coverageTarget: number, // 95
synthesizeData: boolean, // true
frameworks: string[] // ["jest"]
}
}
test_execute
{
spec: {
testSuites: string[], // ["./tests/**/*.test.ts"]
parallelExecution: boolean, // true
retryCount: number, // 3
timeoutSeconds: number, // 300
environments: string[], // ["node"]
reportFormat: "junit" | "tap" | "json"
}
}
Quality Analysis
quality_analyze
{
params: {
scope: "code" | "tests" | "performance" | "security" | "all",
metrics: string[], // ["coverage", "complexity", "duplication"]
thresholds: {
coverage: number, // 95
complexity: number, // 10
duplication: number // 3
}
},
dataSource: {
testResults: string,
codeMetrics: string,
performanceData: string
}
}
Troubleshooting
MCP Server Not Connecting
# Check if MCP server is registered
claude mcp list
# Remove and re-add
claude mcp remove agentic-qe
claude mcp add agentic-qe npx -y agentic-qe mcp:start
# Check logs
tail -f ~/.claude/logs/mcp-agentic-qe.log
Agents Not Spawning
# Verify AQE initialization
aqe init
# Check agent definitions exist
ls .claude/agents/
# Test agent spawn manually
aqe status
Build Issues
# Rebuild MCP server
cd agentic-qe
npm run clean
npm run build
# Verify dist/mcp/start.js exists
ls -la dist/mcp/start.js
Advanced Configuration
Custom MCP Server Config
Create .agentic-qe/mcp-config.json:
{
"server": {
"name": "agentic-qe",
"version": "1.0.0",
"logLevel": "info",
"maxConnections": 10
},
"fleet": {
"defaultTopology": "mesh",
"maxAgents": 50,
"agentTimeout": 300000,
"retryAttempts": 3
},
"capabilities": {
"frameworks": ["jest", "mocha", "cypress", "playwright"],
"languages": ["typescript", "javascript"],
"testTypes": ["unit", "integration", "e2e", "performance"]
}
}
Environment Variables
# MCP Server Configuration
export AQE_MCP_LOG_LEVEL=debug
export AQE_MCP_MAX_AGENTS=100
export AQE_MCP_TIMEOUT=600000
# Test Execution
export AQE_PARALLEL_WORKERS=8
export AQE_TEST_TIMEOUT=60000
export AQE_COVERAGE_THRESHOLD=95
Best Practices
1. Fleet Topology Selection
- Mesh: Best for distributed teams, high reliability
- Hierarchical: Best for large fleets (20+ agents), clear structure
- Ring: Best for sequential workflows, event chains
- Star: Best for centralized control, single coordinator
2. Agent Spawning
- Spawn agents on-demand, not preemptively
- Reuse agents for similar tasks
- Set appropriate timeouts for long-running tasks
3. Test Execution
- Use parallel execution for large test suites
- Enable retry logic for flaky tests
- Set realistic coverage targets (95% recommended)
4. Memory Management
- Fleet scales automatically based on load
- Each agent has 512MB default memory limit
- Monitor fleet status for resource bottlenecks
Resources
- Documentation: docs/
- API Reference: docs/api/
- Examples: examples/
- GitHub: github.com/proffesor-for-testing/agentic-qe
- MCP Specification: modelcontextprotocol.io