Files
Profa fb45e5e763 chore: release v1.6.1 - Advanced QE Skills Phase 3
## New Features

### 3 New Advanced QE Skills
- six-thinking-hats: Edward de Bono's methodology for comprehensive testing analysis
- brutal-honesty-review: Unvarnished technical criticism for code/test quality
- cicd-pipeline-qe-orchestrator: Complete CI/CD quality orchestration (5 phases, 3 workflows)

### Skills Library Growth
- Phase 1: 18 skills (Original Quality Engineering)
- Phase 2: 16 skills (Expanded QE Library)
- Phase 3: 3 skills (Advanced Quality Engineering) ⭐ NEW
- Total: 37 specialized QE skills (up from 34)

## Changes

### Documentation Updates (10 files)
- CHANGELOG.md: v1.6.1 release notes with comprehensive details
- README.md: Updated version badge, skills count (34→37)
- CLAUDE.md: Updated skills count and names in quick reference
- package.json: Version 1.6.0→1.6.1, description updated
- docs/reference/skills.md: Added Phase 3 section
- docs/reference/usage.md: Updated skills count
- src/cli/commands/init-claude-md-template.ts: New condensed template generator
- CI/CD orchestrator files: Updated all references to 37 skills

### Code Updates
- src/cli/commands/init.ts: Added 3 skills to QE_FLEET_SKILLS array
- Updated validation to check for 37 skills (was 34)
- Updated all documentation comments

### New Files (8 files)
- .claude/skills/six-thinking-hats/SKILL.md (1,215 lines)
- .claude/skills/brutal-honesty-review/SKILL.md (725 lines)
- .claude/skills/cicd-pipeline-qe-orchestrator/SKILL.md (510 lines)
- .claude/skills/cicd-pipeline-qe-orchestrator/README.md (290 lines)
- resources/workflows/microservice-pipeline.md (372 lines)
- resources/workflows/monolith-pipeline.md (389 lines)
- resources/workflows/mobile-pipeline.md (497 lines)
- src/cli/commands/init-claude-md-template.ts (99 lines)

## Testing

- ✅ Build: Compiled successfully with no TypeScript errors
- ✅ Init: `aqe init --yes` successfully copies all 37 skills
- ✅ Verification: All 3 new skill directories created with valid SKILL.md
- ✅ CLAUDE.md: Correctly reports "37 QE Skills" with new skill names
- ✅ Lint: No new linting issues introduced
- ✅ Unit Tests: 898 passed, no new failures related to v1.6.1

## Impact

- Skills Coverage: 95%+ of modern QE practices with advanced frameworks
- CI/CD Integration: Complete pipeline orchestration commit→production
- Critical Thinking: Cognitive frameworks for better testing decisions
- Quality Standards: Brutal honesty approach for technical excellence

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-13 15:57:52 +00:00

11 KiB

Agentic QE Fleet - Usage Guide

Complete guide for using the Agentic QE Fleet in your projects.

Quick Start

Installation

npm install agentic-qe-cf --save-dev

Initialization

# Initialize AQE in your project
npx aqe init

# This creates:
# - .claude/agents/       (18 QE agents)
# - .claude/skills/       (37 QE skills)
# - .claude/commands/     (8 slash commands)
# - .agentic-qe/config/   (fleet configuration)
# - .agentic-qe/db/       (learning databases)
# - CLAUDE.md             (project configuration)

Using Agents via Claude Code Task Tool

Recommended Method: Use Claude Code's Task tool for spawning agents.

Single Agent Execution

Task("Generate tests", "Create comprehensive test suite for UserService", "qe-test-generator")

Parallel Agent Execution

// Execute multiple agents concurrently
Task("Test Generation", "Generate unit tests", "qe-test-generator")
Task("Coverage Analysis", "Analyze current coverage", "qe-coverage-analyzer")
Task("Security Scan", "Run security checks", "qe-security-scanner")
Task("Performance Test", "Load test critical paths", "qe-performance-tester")

Agent Coordination Example

// Step 1: Test generator stores results
Task("Generate tests", "Create tests and store in memory at aqe/test-plan/generated", "qe-test-generator")

// Step 2: Test executor reads from memory
Task("Execute tests", "Read test plan from aqe/test-plan/generated and execute", "qe-test-executor")

// Step 3: Coverage analyzer processes results
Task("Analyze coverage", "Check coverage from aqe/coverage/results", "qe-coverage-analyzer")

Using MCP Tools

Check MCP Connection

claude mcp list
# Should show: agentic-qe: npm run mcp:start - ✓ Connected

Using MCP Tools in Claude Code

// Test generation
mcp__agentic_qe__test_generate({ type: "unit", framework: "jest" })

// Test execution
mcp__agentic_qe__test_execute({ parallel: true, coverage: true })

// Quality analysis
mcp__agentic_qe__quality_analyze({ scope: "full" })

Using CLI Commands

Quick Commands

# Generate tests
aqe test <module-name>

# Analyze coverage
aqe coverage

# Run quality gate
aqe quality

# Check fleet status
aqe status

Learning System Commands

# Check learning status
aqe learn status --agent test-gen

# View learned patterns
aqe learn history --agent test-gen --limit 50

# Export learning data
aqe learn export --agent test-gen --output learning.json

Pattern Management

# List test patterns
aqe patterns list --framework jest

# Search patterns
aqe patterns search "api validation"

# Extract patterns from tests
aqe patterns extract ./tests --framework jest

Improvement Loop

# Start continuous improvement
aqe improve start

# Check improvement status
aqe improve status

# Run single improvement cycle
aqe improve cycle

Using Slash Commands

Available Commands

  • /aqe-execute - Execute test suites with parallel orchestration
  • /aqe-generate - Generate comprehensive test suites
  • /aqe-coverage - Analyze test coverage
  • /aqe-quality - Run quality gate validation
  • /aqe-optimize - Optimize test suites using sublinear algorithms
  • /aqe-report - Generate quality engineering reports
  • /aqe-analyze - Analyze coverage gaps
  • /aqe-fleet-status - Display fleet health and metrics

Example Usage

# In Claude Code chat
/aqe-generate
/aqe-execute
/aqe-coverage

Using Skills

Via CLI

# List all available skills
aqe skills list

# Search for specific skills
aqe skills search "testing"

# Show skill details
aqe skills show agentic-quality-engineering

# Show skill statistics
aqe skills stats

Via Skill Tool in Claude Code

// Execute a skill
Skill("agentic-quality-engineering")
Skill("tdd-london-chicago")
Skill("api-testing-patterns")

Agent Coordination

All agents coordinate through AQE hooks (zero external dependencies, 100-500x faster than shell hooks).

Automatic Lifecycle Hooks

Agents extend BaseAgent and override lifecycle methods:

protected async onPreTask(data: { assignment: TaskAssignment }): Promise<void> {
  // Load context before task execution
  const context = await this.memoryStore.retrieve('aqe/context', {
    partition: 'coordination'
  });

  this.logger.info('Pre-task hook complete');
}

protected async onPostTask(data: { assignment: TaskAssignment; result: any }): Promise<void> {
  // Store results after task completion
  await this.memoryStore.store('aqe/' + this.agentId.type + '/results', data.result, {
    partition: 'agent_results',
    ttl: 86400 // 24 hours
  });

  // Emit completion event
  this.eventBus.emit('task:completed', {
    agentId: this.agentId,
    result: data.result
  });

  this.logger.info('Post-task hook complete');
}

protected async onTaskError(data: { assignment: TaskAssignment; error: Error }): Promise<void> {
  // Handle task errors
  await this.memoryStore.store('aqe/errors/' + data.assignment.id, {
    error: data.error.message,
    stack: data.error.stack,
    timestamp: Date.now()
  }, {
    partition: 'errors',
    ttl: 604800 // 7 days
  });

  this.logger.error('Task failed', { error: data.error });
}

Performance Comparison

Feature AQE Hooks External Hooks
Speed <1ms 100-500ms
Dependencies Zero External package
Type Safety Full TypeScript Shell strings
Integration Direct API Shell commands
Performance 100-500x faster Baseline

Memory Namespace

Agents share state through the aqe/* memory namespace:

  • aqe/test-plan/* - Test planning and requirements
  • aqe/coverage/* - Coverage analysis and gaps
  • aqe/quality/* - Quality metrics and gates
  • aqe/performance/* - Performance test results
  • aqe/security/* - Security scan findings
  • aqe/swarm/coordination - Cross-agent coordination

Fleet Configuration

Configuration is stored in .agentic-qe/config/fleet.json:

{
  "topology": "hierarchical",
  "maxAgents": 10,
  "testingFocus": ["unit", "integration"],
  "environments": ["development"],
  "frameworks": ["jest"]
}

Topology Options

  • hierarchical - Queen-led coordination with specialized workers
  • mesh - Peer-to-peer with distributed decision making
  • ring - Circular coordination pattern
  • star - Centralized hub-and-spoke

Multi-Model Router

Status: Disabled by default (opt-in)

Provides 70-81% cost savings by intelligently selecting AI models based on task complexity.

Enabling Routing

Option 1: Via Configuration

// .agentic-qe/config/routing.json
{
  "multiModelRouter": {
    "enabled": true
  }
}

Option 2: Via Environment Variable

export AQE_ROUTING_ENABLED=true

Model Selection Rules

Task Complexity Model Est. Cost Use Case
Simple GPT-3.5 $0.0004 Unit tests, basic validation
Moderate GPT-3.5 $0.0008 Integration tests, mocks
Complex GPT-4 $0.0048 Property-based, edge cases
Critical Claude Sonnet 4.5 $0.0065 Security, architecture review

Monitoring Costs

# View cost dashboard
aqe routing dashboard

# Export cost report
aqe routing report --format json

# Check savings
aqe routing stats

Streaming Progress

Status: Enabled by default

Real-time progress updates for long-running operations using AsyncGenerator pattern.

Example Usage

// Using streaming MCP tool
const handler = new TestExecuteStreamHandler();

for await (const event of handler.execute(params)) {
  if (event.type === 'progress') {
    console.log(`Progress: ${event.percent}% - ${event.message}`);
  } else if (event.type === 'result') {
    console.log('Completed:', event.data);
  }
}

Supported Operations

  • ✅ Test execution (test-by-test progress)
  • ✅ Coverage analysis (incremental gap detection)
  • ⚠️ Test generation (coming soon)
  • ⚠️ Security scanning (coming soon)

Q-Learning Integration

All agents automatically learn from task execution through Q-learning.

Observability

# Check learning status
aqe learn status --agent test-gen

# View learned patterns
aqe learn history --agent test-gen --limit 50

# Export learning data
aqe learn export --agent test-gen --output learning.json

Pattern Management

# List test patterns
aqe patterns list --framework jest

# Search patterns
aqe patterns search "api validation"

# Extract patterns from tests
aqe patterns extract ./tests --framework jest

Improvement Loop

# Start continuous improvement
aqe improve start

# Check improvement status
aqe improve status

# Run single improvement cycle
aqe improve cycle

Best Practices

  1. Use Task Tool: Claude Code's Task tool is the primary way to spawn agents
  2. Batch Operations: Always spawn multiple related agents in a single message
  3. Memory Keys: Use the aqe/* namespace for agent coordination
  4. AQE Hooks: Agents automatically use native AQE hooks for coordination (100-500x faster)
  5. Parallel Execution: Leverage concurrent agent execution for speed

Troubleshooting

Check MCP Connection

claude mcp list
# Should show: agentic-qe: npm run mcp:start - ✓ Connected

View Agent Definitions

ls -la .claude/agents/
# Should show 18 agent markdown files

Check Fleet Status

aqe status --verbose

View Logs

tail -f .agentic-qe/logs/fleet.log

Verify Databases

# Check database files exist
ls -la .agentic-qe/db/

# Query database
node -e "const db = require('better-sqlite3')('.agentic-qe/db/memory.db'); console.log('Tables:', db.prepare('SELECT name FROM sqlite_master WHERE type=\"table\"').all()); db.close();"

Common Workflows

Full Test Generation and Execution

// 1. Generate tests
Task("Generate tests", "Create comprehensive test suite for UserService", "qe-test-generator")

// 2. Execute tests
Task("Execute tests", "Run generated tests with coverage", "qe-test-executor")

// 3. Analyze coverage
Task("Analyze coverage", "Find coverage gaps", "qe-coverage-analyzer")

// 4. Run quality gate
Task("Quality check", "Validate against quality thresholds", "qe-quality-gate")

Security and Performance Validation

// Run in parallel
Task("Security scan", "SAST/DAST security checks", "qe-security-scanner")
Task("Performance test", "Load test with 1000 users", "qe-performance-tester")
Task("API contract check", "Validate API contracts", "qe-api-contract-validator")

Flaky Test Detection and Stabilization

Task("Hunt flaky tests", "Detect and stabilize flaky tests with ML", "qe-flaky-test-hunter")

Related Documentation:

Related Policies: