mirror of
https://github.com/proffesor-for-testing/agentic-qe.git
synced 2026-09-19 08:45:47 +08:00
1e3fbb5ea8
* SwarmMemoryManager Refactoring Plan * fix: add missing directories to npm package (v1.9.3) Added templates/, .claude/helpers/, and docs/reference/ to package.json files array. These were missing from the npm distribution, causing `aqe init` to fail with "Template file not found" errors. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * checkpoint improvements * fix: critical memory/learning system fixes for v1.9.4 ## Critical Fixes - Vector embeddings now stored correctly (was storing NULL) - SQL parameter style fixed for agentdb's SqlJsDatabase wrapper - HNSW index schema mismatch resolved with pattern_id column - Hooks now save to correct database (.agentic-qe/agentdb.db) ## New Features - Added 5 SwarmMemoryManager methods for learning data retrieval: - getBestAction() - Q-learning best action selection - getRecentLearningExperiences() - Recent experience retrieval - getLearningExperiencesByTaskType() - Task-filtered experiences - getHighRewardExperiences() - Successful experience extraction - getLearningStats() - Aggregate learning statistics - Added comprehensive integration test for memory/learning loop - Added RuVector pattern store integration (experimental) ## Technical Details - Vector embeddings: 384 dimensions × 4 bytes = 1,536 bytes per pattern - All 12 integration tests pass - HNSW index: 150x faster vector search enabled 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: move ARM64-only ruvector packages to optionalDependencies Fixes CI failures caused by platform-specific dependencies: - @ruvector/node-linux-arm64-gnu (ARM64 only) - ruvector-core-linux-arm64-gnu (ARM64 only) These packages caused npm ci to fail on x64 CI runners with: "EBADPLATFORM - wanted linux/arm64, current linux/x64" Solution: Move ARM64 packages to optionalDependencies and add x64 variants for cross-platform compatibility. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * chore: regenerate package-lock.json with x64 ruvector packages Updates lockfile to include optional x64 platform packages for CI compatibility: - @ruvector/node-linux-x64-gnu@0.1.17 - ruvector-core-linux-x64-gnu@0.1.15 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: replace fake QUIC with proper implementation and clean up skills manifest QUIC Transport: - Remove fake HTTP/2-based QUICTransport.ts that pretended to be QUIC - Add proper QUIC implementation via Rust/WASM (@agentic-flow/quic-wasm) - Add WebSocket fallback transport for when WASM unavailable - Add dedicated type declarations for optional WASM module - Features: 0-RTT connection, stream multiplexing, TLS 1.3 built-in Skills Manifest: - Rewrite skills-manifest.json with only QE skills (41 skills) - Remove Claude Flow platform skills (agentdb-*, flow-nexus-*, github-*, etc.) - Organize into proper categories: qe-core, testing-methodologies, etc. Bug Fixes: - Fix UnifiedMemoryCoordinator.ts TypeScript errors - Use Logger.getInstance() instead of private constructor - Use swarmMemory.query() instead of non-existent list() method - Use correct close() method signatures for backends 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * feat: add QX Partner agent, compact subagents, fix CLAUDE.md dynamic counts - Add QX Partner agent for Quality Experience analysis combining QA + UX perspectives - Compact 9 subagent definitions to ~80 lines each (88% reduction) - Fix CLAUDE.md template to dynamically count agents (including subagents) and skills - Move CLAUDE.md creation after parallel phases for accurate counts - Remove 'Production-Ready' claim from README and CHANGELOG - Clean up backup files and move docs to proper directory Initialization now correctly reports: - 31 QE Agents (20 main + 11 subagents) - 53 QE Skills - 8 Slash Commands 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: resolve CI failures and security alert #36 - Replace MD5 with SHA-256 for ETag calculation (security alert #36) - Fix CRLF line endings in shell scripts causing parse errors - Remove 'local' keyword from for-loop in test-integration-batched.sh - Use dynamic process.cwd() instead of hardcoded path in jest.config.js - Enhance quality-gate.ts to parse test logs when results file missing 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * feat: Complete Agentic QE Fleet v2.1 implementation (closes #101) ## Implemented Features ### Error Recovery Enhancement (Task 1.3) - CircuitBreaker class with state management (CLOSED/OPEN/HALF_OPEN) - RetryStrategy with exponential/linear/constant backoff - RecoveryOrchestrator with 6 recovery strategies - Transport fallback mechanisms ### Dynamic Skill Loader (Task 2.2) - Metadata-only initial loading (98% token reduction) - On-demand full skill retrieval - LRU caching with configurable TTL (30min default) - Preload suggestions for critical workflows ### Swarm Learning Optimizer (Task 4.1) - Topology recommendation engine (hierarchical/mesh/ring/star) - Agent allocation with capability matching and load balancing - Bottleneck detection (agent/memory/coordination/IO) - Real-time performance adjustments - Added getLatestRecommendation() method ### Workflow Orchestrator (Task 4.2) - AdaptiveScheduler with dynamic strategy selection - Priority-based task queue with age boosting - Task dependency resolution - Work stealing and backpressure handling - Added getQueueDepth() and getStatus() methods ### Unified Memory Coordinator (Task 4.3) - Consolidated memory managers (SQLite, AgentDB, Vector, JSON) - Automatic failover chain with health monitoring - Batch operations and namespace isolation - Periodic sync between backends ### SwarmCoordinator Improvements - Real CPU utilization tracking via process.cpuUsage() - Queue depth from WorkflowOrchestrator - Optimizer recommendations in feedback data - Calculated average complexity from metrics ## Additional Changes - Migration documentation and test restructuring plan - GitHub issue templates and workflows - Test suite improvements and cleanup 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * feat: optimize 38 QE skills with agent-focused format (#102) - Add enhanced YAML frontmatter (tokenEstimate, agents, tags, etc.) - Add <default_to_action> blocks for immediate actionable guidance - Add Quick Reference Cards with tables for at-a-glance info - Add Agent Integration examples using Task() pattern - Add Agent Coordination Hints (memory namespace + fleet coordination) - Condense content optimized for agent consumption - Reduce total token footprint by ~65% across skills Skills updated: - Core QE: agentic-quality-engineering, holistic-testing-pact - Testing Types: api-testing, chaos-engineering, compatibility, compliance, contract, database, exploratory, localization, mobile, mutation, performance, regression, security, visual-testing - Methodologies: tdd-london-chicago, xp-practices, context-driven, risk-based, shift-left, shift-right - Analysis: code-review-quality, quality-metrics, test-design-techniques - Strategy: test-automation-strategy, test-data-management, test-environment-management, test-reporting-analytics - CI/CD: cicd-pipeline-qe-orchestrator, accessibility-testing - Communication: brutal-honesty-review, bug-reporting-excellence, consultancy-practices, sherlock-review, six-thinking-hats, technical-writing - Refactoring: refactoring-patterns Also includes: package.json updates, docs/optimization/, docs/templates/, scripts/validate-skill-optimization.ts Skipped: testability-scoring (pending PR from @fndlalit) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> * release: v2.1.0 - Comprehensive QX Analysis & Skills Optimization ## Summary - Comprehensive QX Analysis with 23+ heuristics (PR #104 by @fndlalit) - 38 QE Skills optimized with agent-focused format (PR #102) - Testability Scoring skill v2.1 with optimized format - QX Partner Agent v2.1 with enhanced capabilities - Fix MCP SDK compatibility for @modelcontextprotocol/sdk bump (PR #105) ## Changes - .claude/agents/qx-partner.md: Updated to v2.1 with domain-specific detection - .claude/skills/testability-scoring/SKILL.md: Optimized format (59% token reduction) - src/mcp/server.ts: Removed deprecated 'description' field for MCP SDK compatibility - package.json: Bumped version to 2.1.0 - README.md: Updated version and release notes - CHANGELOG.md: Added v2.1.0 release notes 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> --------- Co-authored-by: Claude <noreply@anthropic.com>
688 lines
20 KiB
TypeScript
688 lines
20 KiB
TypeScript
/**
|
|
* QXPartnerAgent Unit Tests
|
|
* Tests for Quality Experience (QX) analysis agent
|
|
*/
|
|
|
|
// Jest test file - using jest globals
|
|
import { QXPartnerAgent } from '../../../src/agents/QXPartnerAgent';
|
|
import { QEAgentType } from '../../../src/types';
|
|
import { QXTaskType, QXHeuristic } from '../../../src/types/qx';
|
|
import { EventEmitter } from 'events';
|
|
|
|
describe('QXPartnerAgent', () => {
|
|
let agent: QXPartnerAgent;
|
|
let eventBus: EventEmitter;
|
|
let memoryStore: any;
|
|
|
|
beforeEach(async () => {
|
|
eventBus = new EventEmitter();
|
|
memoryStore = {
|
|
get: jest.fn().mockResolvedValue(null),
|
|
set: jest.fn().mockResolvedValue(undefined),
|
|
has: jest.fn().mockResolvedValue(false),
|
|
delete: jest.fn().mockResolvedValue(true),
|
|
keys: jest.fn().mockResolvedValue([]),
|
|
clear: jest.fn().mockResolvedValue(undefined),
|
|
// Required by VerificationHookManager
|
|
store: jest.fn().mockResolvedValue(undefined),
|
|
retrieve: jest.fn().mockResolvedValue(null)
|
|
};
|
|
|
|
agent = new QXPartnerAgent({
|
|
analysisMode: 'full',
|
|
integrateTestability: true,
|
|
detectOracleProblems: true,
|
|
heuristics: {
|
|
enabledHeuristics: [QXHeuristic.PROBLEM_UNDERSTANDING, QXHeuristic.RULE_OF_THREE],
|
|
minConfidence: 0.7
|
|
},
|
|
context: {
|
|
workspaceRoot: '/test',
|
|
project: 'test-project',
|
|
environment: 'test'
|
|
},
|
|
memoryStore,
|
|
eventBus
|
|
});
|
|
|
|
await agent.initialize();
|
|
});
|
|
|
|
afterEach(async () => {
|
|
if (agent) {
|
|
await agent.terminate();
|
|
}
|
|
});
|
|
|
|
describe('Initialization', () => {
|
|
it('should initialize with correct agent type', () => {
|
|
const agentId = agent.getAgentId();
|
|
expect(agentId.type).toBe(QEAgentType.QX_PARTNER);
|
|
});
|
|
|
|
it('should have QX-specific capabilities', () => {
|
|
const capabilities = agent.getCapabilities();
|
|
const capabilityNames = Array.from(capabilities.values()).map(c => c.name);
|
|
|
|
expect(capabilityNames).toContain('qx-analysis');
|
|
expect(capabilityNames).toContain('oracle-problem-detection');
|
|
expect(capabilityNames).toContain('ux-heuristics');
|
|
expect(capabilityNames).toContain('impact-analysis');
|
|
expect(capabilityNames).toContain('balance-finder');
|
|
expect(capabilityNames).toContain('testability-integration');
|
|
});
|
|
|
|
it('should be in idle status after initialization', () => {
|
|
const status = agent.getStatus();
|
|
expect(status).toBe('idle');
|
|
});
|
|
});
|
|
|
|
describe('Full QX Analysis', () => {
|
|
it('should perform full QX analysis', async () => {
|
|
const task = {
|
|
id: 'test-full-analysis',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com',
|
|
params: {
|
|
context: {
|
|
feature: 'test-feature'
|
|
}
|
|
}
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(result).toBeDefined();
|
|
expect(result.overallScore).toBeGreaterThanOrEqual(0);
|
|
expect(result.overallScore).toBeLessThanOrEqual(100);
|
|
expect(result.grade).toMatch(/^[ABCDF]$/);
|
|
expect(result.target).toBe('https://example.com');
|
|
expect(result.problemAnalysis).toBeDefined();
|
|
expect(result.userNeeds).toBeDefined();
|
|
expect(result.businessNeeds).toBeDefined();
|
|
expect(result.impactAnalysis).toBeDefined();
|
|
expect(result.recommendations).toBeDefined();
|
|
expect(Array.isArray(result.recommendations)).toBe(true);
|
|
});
|
|
|
|
it('should include testability integration when enabled', async () => {
|
|
const task = {
|
|
id: 'test-with-testability',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com',
|
|
config: {
|
|
integrateTestability: true
|
|
}
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(result.testabilityIntegration).toBeDefined();
|
|
expect(result.testabilityIntegration?.qxRelation).toBeDefined();
|
|
expect(result.testabilityIntegration?.combinedInsights).toBeDefined();
|
|
});
|
|
|
|
it('should detect oracle problems when enabled', async () => {
|
|
const task = {
|
|
id: 'test-oracle-detection',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com',
|
|
config: {
|
|
detectOracleProblems: true
|
|
}
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(result.oracleProblems).toBeDefined();
|
|
expect(Array.isArray(result.oracleProblems)).toBe(true);
|
|
});
|
|
});
|
|
|
|
describe('Oracle Problem Detection', () => {
|
|
it('should detect oracle problems only', async () => {
|
|
const task = {
|
|
id: 'test-oracle-only',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.ORACLE_DETECTION,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(Array.isArray(result)).toBe(true);
|
|
// Result may be empty array if no oracle problems detected
|
|
if (result.length > 0) {
|
|
expect(result[0]).toHaveProperty('type');
|
|
expect(result[0]).toHaveProperty('description');
|
|
expect(result[0]).toHaveProperty('severity');
|
|
expect(result[0]).toHaveProperty('resolutionApproach');
|
|
}
|
|
});
|
|
|
|
it('should filter oracle problems by minimum severity', async () => {
|
|
const agentWithHighSeverity = new QXPartnerAgent({
|
|
analysisMode: 'full',
|
|
integrateTestability: false,
|
|
detectOracleProblems: true,
|
|
minOracleSeverity: 'high',
|
|
heuristics: {
|
|
enabledHeuristics: [QXHeuristic.ORACLE_PROBLEM_DETECTION],
|
|
minConfidence: 0.7
|
|
},
|
|
context: {
|
|
workspaceRoot: '/test',
|
|
project: 'test-project',
|
|
environment: 'test'
|
|
},
|
|
memoryStore,
|
|
eventBus
|
|
});
|
|
|
|
await agentWithHighSeverity.initialize();
|
|
|
|
const task = {
|
|
id: 'test-high-severity',
|
|
assignee: agentWithHighSeverity.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.ORACLE_DETECTION,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agentWithHighSeverity.executeTask(task);
|
|
|
|
// All problems should be high or critical severity
|
|
if (result.length > 0) {
|
|
result.forEach((problem: any) => {
|
|
expect(['high', 'critical']).toContain(problem.severity);
|
|
});
|
|
}
|
|
|
|
await agentWithHighSeverity.terminate();
|
|
});
|
|
});
|
|
|
|
describe('User vs Business Balance Analysis', () => {
|
|
it('should analyze user-business balance', async () => {
|
|
const task = {
|
|
id: 'test-balance',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.BALANCE_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(result).toBeDefined();
|
|
expect(result.userNeeds).toBeDefined();
|
|
expect(result.businessNeeds).toBeDefined();
|
|
expect(result.balance).toBeDefined();
|
|
expect(result.balance).toHaveProperty('isBalanced');
|
|
expect(result.balance).toHaveProperty('recommendation');
|
|
expect(typeof result.balance.isBalanced).toBe('boolean');
|
|
});
|
|
|
|
it('should identify when favoring users', async () => {
|
|
const task = {
|
|
id: 'test-user-favor',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.BALANCE_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
if (result.balance.favorsUser) {
|
|
expect(result.balance.favorsBusiness).toBe(false);
|
|
expect(result.userNeeds.alignmentScore).toBeGreaterThan(result.businessNeeds.alignmentScore);
|
|
}
|
|
});
|
|
});
|
|
|
|
describe('Impact Analysis', () => {
|
|
it('should perform impact analysis', async () => {
|
|
const task = {
|
|
id: 'test-impact',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.IMPACT_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(result).toBeDefined();
|
|
expect(result).toHaveProperty('visible');
|
|
expect(result).toHaveProperty('invisible');
|
|
expect(result).toHaveProperty('immutableRequirements');
|
|
expect(result).toHaveProperty('overallImpactScore');
|
|
expect(result.overallImpactScore).toBeGreaterThanOrEqual(0);
|
|
expect(result.overallImpactScore).toBeLessThanOrEqual(100);
|
|
});
|
|
});
|
|
|
|
describe('Heuristics Application', () => {
|
|
it('should apply specific heuristic', async () => {
|
|
const task = {
|
|
id: 'test-heuristic',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.APPLY_HEURISTIC,
|
|
target: 'https://example.com',
|
|
params: {
|
|
heuristic: QXHeuristic.RULE_OF_THREE
|
|
}
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(result).toBeDefined();
|
|
expect(result).toHaveProperty('name');
|
|
expect(result).toHaveProperty('category');
|
|
expect(result).toHaveProperty('applied');
|
|
expect(result).toHaveProperty('score');
|
|
expect(result).toHaveProperty('findings');
|
|
expect(result).toHaveProperty('issues');
|
|
expect(result).toHaveProperty('recommendations');
|
|
expect(result.score).toBeGreaterThanOrEqual(0);
|
|
expect(result.score).toBeLessThanOrEqual(100);
|
|
});
|
|
|
|
it('should throw error if heuristic parameter missing', async () => {
|
|
const task = {
|
|
id: 'test-missing-heuristic',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.APPLY_HEURISTIC,
|
|
target: 'https://example.com',
|
|
params: {}
|
|
}
|
|
}
|
|
};
|
|
|
|
await expect(agent.executeTask(task)).rejects.toThrow('Heuristic parameter is required');
|
|
});
|
|
});
|
|
|
|
describe('Recommendations Generation', () => {
|
|
it('should generate QX recommendations', async () => {
|
|
const task = {
|
|
id: 'test-recommendations',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.GENERATE_RECOMMENDATIONS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(Array.isArray(result)).toBe(true);
|
|
if (result.length > 0) {
|
|
const rec = result[0];
|
|
expect(rec).toHaveProperty('principle');
|
|
expect(rec).toHaveProperty('recommendation');
|
|
expect(rec).toHaveProperty('severity');
|
|
expect(rec).toHaveProperty('impact');
|
|
expect(rec).toHaveProperty('effort');
|
|
expect(rec).toHaveProperty('priority');
|
|
expect(rec).toHaveProperty('category');
|
|
expect(['low', 'medium', 'high', 'critical']).toContain(rec.severity);
|
|
expect(['low', 'medium', 'high']).toContain(rec.effort);
|
|
expect(['ux', 'qa', 'qx', 'technical', 'process', 'design']).toContain(rec.category);
|
|
}
|
|
});
|
|
|
|
it('should sort recommendations by priority', async () => {
|
|
const task = {
|
|
id: 'test-sorted-recs',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.GENERATE_RECOMMENDATIONS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
if (result.length > 1) {
|
|
for (let i = 1; i < result.length; i++) {
|
|
// Priority should be non-decreasing (lower priority number = higher priority)
|
|
expect(result[i].priority).toBeGreaterThanOrEqual(result[i - 1].priority);
|
|
}
|
|
}
|
|
});
|
|
});
|
|
|
|
describe('Scoring System', () => {
|
|
it('should calculate scores within valid range', async () => {
|
|
const task = {
|
|
id: 'test-scoring',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
expect(result.overallScore).toBeGreaterThanOrEqual(0);
|
|
expect(result.overallScore).toBeLessThanOrEqual(100);
|
|
expect(result.problemAnalysis.clarityScore).toBeGreaterThanOrEqual(0);
|
|
expect(result.problemAnalysis.clarityScore).toBeLessThanOrEqual(100);
|
|
expect(result.userNeeds.alignmentScore).toBeGreaterThanOrEqual(0);
|
|
expect(result.userNeeds.alignmentScore).toBeLessThanOrEqual(100);
|
|
expect(result.businessNeeds.alignmentScore).toBeGreaterThanOrEqual(0);
|
|
expect(result.businessNeeds.alignmentScore).toBeLessThanOrEqual(100);
|
|
});
|
|
|
|
it('should assign correct grade based on score', async () => {
|
|
const task = {
|
|
id: 'test-grading',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await agent.executeTask(task);
|
|
|
|
const score = result.overallScore;
|
|
const expectedGrade = score >= 90 ? 'A' :
|
|
score >= 80 ? 'B' :
|
|
score >= 70 ? 'C' :
|
|
score >= 60 ? 'D' : 'F';
|
|
|
|
expect(result.grade).toBe(expectedGrade);
|
|
});
|
|
});
|
|
|
|
describe('Memory Operations', () => {
|
|
it('should store analysis results in memory', async () => {
|
|
const task = {
|
|
id: 'test-memory',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
await agent.executeTask(task);
|
|
|
|
// Verify memory store was called
|
|
expect(memoryStore.set).toHaveBeenCalled();
|
|
});
|
|
|
|
it('should retrieve historical analyses from memory', async () => {
|
|
const historicalData = {
|
|
analyses: [
|
|
{ target: 'https://example.com', score: 75 }
|
|
]
|
|
};
|
|
|
|
memoryStore.get.mockResolvedValueOnce(historicalData);
|
|
|
|
const task = {
|
|
id: 'test-history',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
await agent.executeTask(task);
|
|
|
|
expect(memoryStore.get).toHaveBeenCalled();
|
|
});
|
|
});
|
|
|
|
describe('Configuration', () => {
|
|
it('should respect analysis mode configuration', async () => {
|
|
const quickAgent = new QXPartnerAgent({
|
|
analysisMode: 'quick',
|
|
integrateTestability: false,
|
|
detectOracleProblems: false,
|
|
heuristics: {
|
|
enabledHeuristics: [QXHeuristic.PROBLEM_UNDERSTANDING],
|
|
minConfidence: 0.7
|
|
},
|
|
context: {
|
|
workspaceRoot: '/test',
|
|
project: 'test-project',
|
|
environment: 'test'
|
|
},
|
|
memoryStore,
|
|
eventBus
|
|
});
|
|
|
|
await quickAgent.initialize();
|
|
|
|
const task = {
|
|
id: 'test-quick',
|
|
assignee: quickAgent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await quickAgent.executeTask(task);
|
|
|
|
expect(result).toBeDefined();
|
|
expect(result.overallScore).toBeDefined();
|
|
|
|
await quickAgent.terminate();
|
|
});
|
|
|
|
it('should respect custom thresholds', async () => {
|
|
const strictAgent = new QXPartnerAgent({
|
|
analysisMode: 'full',
|
|
integrateTestability: false,
|
|
detectOracleProblems: true,
|
|
heuristics: {
|
|
enabledHeuristics: [QXHeuristic.PROBLEM_UNDERSTANDING],
|
|
minConfidence: 0.7
|
|
},
|
|
thresholds: {
|
|
minQXScore: 80,
|
|
minProblemClarity: 70,
|
|
minUserNeedsAlignment: 80,
|
|
minBusinessAlignment: 75
|
|
},
|
|
context: {
|
|
workspaceRoot: '/test',
|
|
project: 'test-project',
|
|
environment: 'test'
|
|
},
|
|
memoryStore,
|
|
eventBus
|
|
});
|
|
|
|
await strictAgent.initialize();
|
|
|
|
const task = {
|
|
id: 'test-strict',
|
|
assignee: strictAgent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
const result = await strictAgent.executeTask(task);
|
|
|
|
expect(result).toBeDefined();
|
|
|
|
await strictAgent.terminate();
|
|
});
|
|
});
|
|
|
|
describe('Error Handling', () => {
|
|
it('should handle invalid task type', async () => {
|
|
const task = {
|
|
id: 'test-invalid',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: 'invalid-task-type' as any,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
};
|
|
|
|
await expect(agent.executeTask(task)).rejects.toThrow();
|
|
});
|
|
|
|
it('should handle missing target', async () => {
|
|
const task = {
|
|
id: 'test-no-target',
|
|
assignee: agent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: '',
|
|
params: {}
|
|
}
|
|
}
|
|
};
|
|
|
|
// Should still execute but may have limited results
|
|
const result = await agent.executeTask(task);
|
|
expect(result).toBeDefined();
|
|
});
|
|
});
|
|
|
|
describe('Agent Lifecycle', () => {
|
|
it('should transition through lifecycle states', async () => {
|
|
const newAgent = new QXPartnerAgent({
|
|
analysisMode: 'full',
|
|
integrateTestability: false,
|
|
detectOracleProblems: false,
|
|
heuristics: {
|
|
enabledHeuristics: [QXHeuristic.PROBLEM_UNDERSTANDING],
|
|
minConfidence: 0.7
|
|
},
|
|
context: {
|
|
workspaceRoot: '/test',
|
|
project: 'test-project',
|
|
environment: 'test'
|
|
},
|
|
memoryStore,
|
|
eventBus
|
|
});
|
|
|
|
// Before initialization
|
|
expect(newAgent.getStatus()).toBe('initializing');
|
|
|
|
await newAgent.initialize();
|
|
|
|
// After initialization
|
|
expect(newAgent.getStatus()).toBe('idle');
|
|
|
|
// During task execution
|
|
const taskPromise = newAgent.executeTask({
|
|
id: 'test-lifecycle',
|
|
assignee: newAgent.getAgentId(),
|
|
task: {
|
|
type: 'qx-task',
|
|
payload: {
|
|
type: QXTaskType.FULL_ANALYSIS,
|
|
target: 'https://example.com'
|
|
}
|
|
}
|
|
});
|
|
|
|
// Status should be active during execution
|
|
// Note: This is timing-dependent and may not always catch the active state
|
|
|
|
await taskPromise;
|
|
|
|
// After task completion
|
|
expect(newAgent.getStatus()).toBe('idle');
|
|
|
|
await newAgent.terminate();
|
|
|
|
// After termination
|
|
expect(newAgent.getStatus()).toBe('terminated');
|
|
});
|
|
});
|
|
});
|