skills/proffesor-for-testing__agentic-qe
1
0
Fork 0
mirror of https://github.com/proffesor-for-testing/agentic-qe.git synced 2026-09-19 08:45:47 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,539 Commits 166 Branches 294 Tags
benchmarks
Commit Graph

17 Commits

Author SHA1 Message Date
Profa f92d560339 feat(v3): implement ADR-058 @claude-flow/guidance governance integration 
Wire pre-built governance modules to AQE v3 infrastructure:

Core Governance Modules (16):
- ContinueGate: Agent loop detection and prevention
- MemoryWriteGate: Contradiction detection for pattern storage
- TrustAccumulator: Agent trust scoring and routing
- ConstitutionalEnforcer: 7 invariant enforcement
- ComplianceReporter: Violation tracking and audit reporting
- DeterministicToolGateway: Idempotency enforcement
- ProofEnvelope: Hash-chained audit trails
- Evolution Pipeline: Rule optimization from run history
- ShardRetriever: Domain-specific rule loading
- WASM Kernel: Security-critical crypto operations
- Adversarial Defense: Injection detection
- A/B Benchmarking: Performance comparison

Integration Points:
- QueenCoordinator: beforeTaskExecution/afterTaskExecution hooks
- RealQEReasoningBank: evaluateWrite/registerPattern gating
- MCP memory handlers: memory_store/memory_share validation
- All 12 domain coordinators: GovernanceAwareDomainMixin

Constitutional Invariants Wired:
- #2: Security scan required (security-compliance domain)
- #3: Backup before delete (chaos-resilience domain)

Tests: 657 passing (13 governance integration test files)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-02-04 08:57:12 +00:00
Profa ab712ee3ed chore(release): v3.1.0 - browser automation & quality criteria integration 
Major features:
- @claude-flow/browser integration with parallel viewport testing (4x faster)
- 9 browser workflow templates (login, oauth, forms, visual regression, a11y)
- BrowserSecurityScanner with URL validation and PII detection
- security-visual-testing skill (skill count: 61)
- Quality Criteria E2E integration tests (18 E2E + 15 unit tests)
- QualityCriteriaService with HTSM v6.3 analysis
- SFDIPOT Assessment Validator script

Fixed:
- 21 GitHub Code Scanning vulnerabilities (ReDoS, SHA-1, sanitization)

Changed:
- V2 agents removed (available as V3 agents in v3/assets/)
- qe-test-idea-rewriter now requires validation step
- Version bump: 3.0.0-alpha → 3.1.0

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-21 20:33:50 +00:00
Profa 7a1179c05e Agentic QE v2 vs v3 updated with recent changes 2026-01-21 12:58:48 +00:00
Profa b641a1518e update v2-vs-v3 comparison with latest improvements 2026-01-20 12:33:27 +00:00
Profa e154b6bf40 feat(v3): implement RuVector Neural Backbone with persistent learning (ADR-050) 
GOAP Implementation - 8/8 Actions Complete:
1. ML Observability Layer - Track ML vs fallback usage
2. PersistentQLearningRouter - Q-values persist across sessions with EWC++
3. PersistentSONAEngine - SONA patterns persist across sessions
4. Remove Silent Fallbacks - All fallbacks now observable
5. Hypergraph Schema - SQLite-backed code graph storage
6. HypergraphEngine - Query engine for code intelligence
7. Coordinator Integration - All 7 domain coordinators + provider use persistent engines
8. RuVector Server Client - Stubbed with supportsVectorOperations() guard

Key Changes:
- All domain coordinators migrated to PersistentSONAEngine
- DefaultRuVectorClient uses PersistentQLearningRouter
- RuVectorServiceProvider.getGlobalSONA() now async with persistence
- HypergraphEngine integrated in code-intelligence coordinator
- 491+ tests passing, TypeScript clean

README Updates:
- Performance table updated with verified claims only
- Removed unverified speedup claims
- Added persistent learning features (EWC++, Q-value persistence)

New Files:
- persistent-q-router.ts - Q-Learning with SQLite persistence
- sona-persistence.ts - SONA with pattern persistence
- hypergraph-schema.ts - Graph node/edge schema
- hypergraph-engine.ts - Code intelligence queries
- server-client.ts - RuVector server integration
- shared-memory.ts - Fleet shared memory
- observability.ts - ML usage tracking

Documentation:
- ADR-050: RuVector Neural Backbone specification
- BRUTAL-HONESTY-GOAP-REVIEW.md - Integration verification
- Migrated ADRs to standardized MADR format

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-20 10:46:42 +00:00
Profa e8b2ae6094 feat(v3): add TinyDancer routing, consensus engine, and documentation updates 
Major Features:
- TinyDancer 3-tier model routing (ADR-026): Haiku/Sonnet/Opus based on complexity
- Multi-model consensus engine with Byzantine fault tolerance
- Claim verifier service for agent work validation
- Code intelligence metric collectors (LOC, test counts)
- Fleet integration with init wizard

Documentation:
- Update README with 50 agents (43 main + 7 subagents)
- Add TinyDancer, Dream cycles, Consensus sections
- Remove unverified performance claims (keep 166x MCP verified)
- Create v2-vs-v3 comparison document
- Add reference docs for AQE fleet and Claude Flow

Testing:
- Add consensus engine unit tests
- Add queen-tinydancer wiring integration tests
- Add security-consensus wiring tests
- Add claim verifier integration tests
- Add fleet integration tests

Bump version to 3.0.0-alpha.28

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-18 17:33:22 +00:00
Profa fd2f37eaa0 fix(v3): update README claims and init hooks to use correct package name 
Changes:
- Fix README.md agent counts (48 QE agents = 41 main + 7 subagents)
- Fix README.md skill counts (15 QE-specific skills)
- Fix v3/README.md agent counts (47 → 48)
- Fix init-wizard.ts hooks from 'npx @agentic-qe/v3' to 'npx agentic-qe'
- Complete v2 → v2/ folder reorganization (54 items moved)
- Update root package.json to point to v3 as main version

Verified claims:
- 48 QE agents (41 main + 7 TDD subagents)
- 15 QE-specific skills
- 12 DDD bounded contexts
- ~5,600+ tests
- HNSW, ReasoningBank, Queen Coordinator features exist

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-17 18:03:40 +00:00
Profa 1612877abc feat(v3): implement ADR-048 v2-to-v3 migration with schema compatibility 
## Migration Features
- Add migrate CLI command with run/status/verify/rollback/mapping subcommands
- Implement agent name migration (Step 8) with v2_compat metadata
- Add v2 schema compatibility handling in UnifiedMemoryManager
- Create agent-compat.ts with complete v2→v3 agent mapping table
- Add lazy-loading for HNSW index to improve CLI startup performance

## Schema Migration
- Detect and upgrade incompatible v2 tables (goap_plans, concept_nodes, etc.)
- Drop and recreate tables with different column schemas
- Preserve v2 data in compatible tables (memory_entries, events, etc.)

## Bug Fixes
- Add process.exit(0) to init and migrate commands to prevent stuck processes
- Fix incorrect heuristic_fn column check that would drop valid tables
- Handle v2 databases with different GOAP/Dream/RL table schemas

## Agent Migration
- Migrate deprecated agent names to v3 equivalents
- Add v2_compat field to agent frontmatter for backwards compatibility
- Archive old agent files to deprecated/ directory
- Replace agent name references in body content

## Tests
- Add 7 integration tests for migrate file operations
- Add 33 unit tests for migrate command

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-17 14:31:21 +00:00
Profa faf9c84221 feat(edge): add @ruvector/edge browser integration (Phase 0) 
Implements browser-compatible QE agents using @ruvector/edge WASM:

- Add BrowserHNSWAdapter with real @ruvector/edge WasmHnswIndex
- Add IndexedDBStorage for browser-side vector persistence
- Add BrowserAgent for WASM-compatible agent lifecycle
- Add Chrome DevTools panel for agent monitoring
- Add build:edge script producing 183.4KB gzipped bundle

Verified metrics (not estimated):
- Bundle size: 183.4 KB gzipped (target: <400KB) ✓
- Tests: 173/177 passing (4 expected failures in Node.js)
- Build: TypeScript compilation succeeds

Analysis documents:
- GOAP evaluation of @ruvector/edge integration
- Visionary analysis with 12 novel use cases
- Implementation plan for 5 phases

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-02 13:34:17 +00:00
Profa acb5973186 feat(providers): LLM Independence Phase 3-4 complete 
## New Features

### LLM Providers
- GroqProvider: Free tier (14.4k req/day), streaming, rate limiting
- GitHubModelsProvider: Codespaces auto-detection, GITHUB_TOKEN auth

### Provider Health Monitoring
- ProviderHealthMonitor: Circuit breaker pattern (closed → half-open → open)
- QuotaManager: Per-provider quota tracking with daily/minute limits
- HybridRouterHealthIntegration: Health-aware routing with fallback

### CLI Commands
- `aqe providers status`: Health dashboard
- `aqe providers list`: List configured providers
- `aqe providers test`: Test provider connectivity
- `aqe providers switch`: Switch default provider
- `aqe providers quota`: Show quota usage

## Tests
- 144 new tests for Phase 3-4 components

## Documentation
- Updated README with Provider Health Monitoring section
- Updated CHANGELOG with v2.6.5 features
- Updated implementation plan to COMPLETE status

Closes #169

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2025-12-25 16:02:05 +00:00
Profa cb27ee303f feat(v2.5.0): G4 BinaryCache + G6 OpenRouter hot-swap + ruvLLM integration 
## Major Features

### G4: Unified Memory Architecture - BinaryCache Integration
- Integrate BinaryMetadataCache with UnifiedMemoryCoordinator
- Add TRM pattern caching with 6x faster pattern loading
- New methods: cacheTRMPattern(), getCachedTRMPattern(), persistBinaryCache()

### G6: OpenRouter Provider with Model Hot-Swap
- Full ILLMProvider implementation for OpenRouter API (300+ models)
- Model hot-swapping at runtime without restart
- Smart environment detection for auto provider selection

### ruvLLM Integration (Issue #131)
- SONA Learning Strategy with MicroLoRA/BaseLoRA/EWC++
- TRM Learning Strategy for trajectory tracking
- ReasoningBank integration for pattern storage
- 104 new integration tests

Closes #131

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2025-12-13 18:09:30 +00:00
Profa 11dfbcbf35 chore(release): bump version to v2.4.0 
## Added
- Binary Metadata Cache with 6x faster pattern loading
- AI-Friendly Output Mode with structured JSON output
- Automated Benchmarks in CI with regression detection
- Strategy-Based Agent Architecture foundation (36% BaseAgent reduction)

## Fixed
- ExecutionEvent interface mismatch in BaseAgent learning hooks
- AgentStateData missing timestamp in saveState
- Deprecated direct agentDB access in FlakyTestHunter, TestExecutor, TestGenerator
- AdapterConfigValidator tests using validateOrThrow()
- QXPartnerAgent tests using correct store/retrieve methods
- FleetCommanderAgent lifecycle test expecting IDLE after init

## Tests
- 425 new tests for performance infrastructure
- Strategy pattern tests: 92 passing
- Agent tests: 166 passing
- Adapter fail-fast tests: 17 passing

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2025-12-13 11:09:49 +00:00
Profa 514313d416 feat(mcp): implement Phase 3 hierarchical tool loading (Issue #115) 
Phase 3 Track H - Tool Categories:
- Add category comments to all 95 tool definitions
- Organize tools with section headers (11 major sections)
- Enhance tools_discover with category filtering (comma-separated)
- Add tools_discover and tools_load_domain to TOOL_NAMES

Phase 3 Track I - Keyword Auto-Loading:
- Expand keywords from 81 to 341 across 7 domains
- Add domain relationships (security→quality, coverage→quality, etc.)
- Implement tool caching with usage tracking
- Add auto-load metrics and history tracking

Verified Metrics:
- Initial load: 95 → 12 core tools (87% reduction)
- Token cost: ~18,652 → ~2,463 tokens (87% savings)
- Keyword coverage: 341 keywords across 9 domains
- Auto-detection: Working for all domains

Files Changed:
- src/mcp/tools.ts - Category comments, section headers
- src/mcp/tool-categories.ts - 341 keywords, domain relationships
- src/mcp/lazy-loader.ts - Usage tracking, caching
- src/mcp/server.ts - Enhanced tools_discover handler

Documentation:
- docs/analysis/phase3-track-h-category-assignment.md
- docs/analysis/phase3-tracki-keyword-enhancements.md

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-12-06 08:42:42 +00:00
Profa 56d1502089 feat(mcp): implement Phase 1 & 2 tool optimization (Issue #115) 
Phase 1 Track A - Legacy Tool Removal:
- Remove 11 legacy tools from agenticQETools array
- Remove corresponding TOOL_NAMES entries
- Remove legacy handler registrations from server.ts
- Legacy tools removed: test_generate, quality_analyze, predict_defects,
  optimize_tests, quality_gate_execute, quality_validate_metrics,
  quality_risk_assess, quality_decision_make, quality_policy_check,
  requirements_validate, requirements_generate_bdd

Phase 2 - Lazy Loading Integration:
- Wire ListToolsRequestSchema to use lazy loader
- Return only 14 core tools on initial load (vs 84 total)
- Domain-specific tools loaded on-demand via tools_load_domain
- Add tools_discover and tools_load_domain meta-tools
- Add tool-categories.ts with domain organization
- Add lazy-loader.ts for dynamic tool loading
- Add server-instructions.ts for MCP instructions

Additional Changes:
- Add analysis documentation for optimization work
- Add IntervalRegistry utility for timer management
- Update jest.setup.ts and MemoryManager for stability
- Add coverage tools consolidation plan

Verified Metrics:
- Tool count: 98 → 84 (-14 legacy tools)
- Initial load: 84 → 14 tools
- Token reduction: ~16,885 → ~2,612 tokens (85% reduction)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-12-05 18:49:18 +00:00
Dragan Spiridonov 346438f0de Release v2.0.0: Claude 4.5 Optimization, QUIC Transport, 29 Agent Compaction (#100) 
* SwarmMemoryManager Refactoring Plan

* fix: add missing directories to npm package (v1.9.3)

Added templates/, .claude/helpers/, and docs/reference/ to package.json
files array. These were missing from the npm distribution, causing
`aqe init` to fail with "Template file not found" errors.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* checkpoint improvements

* fix: critical memory/learning system fixes for v1.9.4

## Critical Fixes
- Vector embeddings now stored correctly (was storing NULL)
- SQL parameter style fixed for agentdb's SqlJsDatabase wrapper
- HNSW index schema mismatch resolved with pattern_id column
- Hooks now save to correct database (.agentic-qe/agentdb.db)

## New Features
- Added 5 SwarmMemoryManager methods for learning data retrieval:
  - getBestAction() - Q-learning best action selection
  - getRecentLearningExperiences() - Recent experience retrieval
  - getLearningExperiencesByTaskType() - Task-filtered experiences
  - getHighRewardExperiences() - Successful experience extraction
  - getLearningStats() - Aggregate learning statistics
- Added comprehensive integration test for memory/learning loop
- Added RuVector pattern store integration (experimental)

## Technical Details
- Vector embeddings: 384 dimensions × 4 bytes = 1,536 bytes per pattern
- All 12 integration tests pass
- HNSW index: 150x faster vector search enabled

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: move ARM64-only ruvector packages to optionalDependencies

Fixes CI failures caused by platform-specific dependencies:
- @ruvector/node-linux-arm64-gnu (ARM64 only)
- ruvector-core-linux-arm64-gnu (ARM64 only)

These packages caused npm ci to fail on x64 CI runners with:
"EBADPLATFORM - wanted linux/arm64, current linux/x64"

Solution: Move ARM64 packages to optionalDependencies and add
x64 variants for cross-platform compatibility.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: regenerate package-lock.json with x64 ruvector packages

Updates lockfile to include optional x64 platform packages for
CI compatibility:
- @ruvector/node-linux-x64-gnu@0.1.17
- ruvector-core-linux-x64-gnu@0.1.15

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: replace fake QUIC with proper implementation and clean up skills manifest

QUIC Transport:
- Remove fake HTTP/2-based QUICTransport.ts that pretended to be QUIC
- Add proper QUIC implementation via Rust/WASM (@agentic-flow/quic-wasm)
- Add WebSocket fallback transport for when WASM unavailable
- Add dedicated type declarations for optional WASM module
- Features: 0-RTT connection, stream multiplexing, TLS 1.3 built-in

Skills Manifest:
- Rewrite skills-manifest.json with only QE skills (41 skills)
- Remove Claude Flow platform skills (agentdb-*, flow-nexus-*, github-*, etc.)
- Organize into proper categories: qe-core, testing-methodologies, etc.

Bug Fixes:
- Fix UnifiedMemoryCoordinator.ts TypeScript errors
- Use Logger.getInstance() instead of private constructor
- Use swarmMemory.query() instead of non-existent list() method
- Use correct close() method signatures for backends

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* feat: add QX Partner agent, compact subagents, fix CLAUDE.md dynamic counts

- Add QX Partner agent for Quality Experience analysis combining QA + UX perspectives
- Compact 9 subagent definitions to ~80 lines each (88% reduction)
- Fix CLAUDE.md template to dynamically count agents (including subagents) and skills
- Move CLAUDE.md creation after parallel phases for accurate counts
- Remove 'Production-Ready' claim from README and CHANGELOG
- Clean up backup files and move docs to proper directory

Initialization now correctly reports:
- 31 QE Agents (20 main + 11 subagents)
- 53 QE Skills
- 8 Slash Commands

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

---------

Co-authored-by: Claude <noreply@anthropic.com>
 2025-12-02 11:31:30 +01:00
Profa b3d2018ee2 feat: v1.8.0 - Quality Hardening & Pattern Isolation 
Critical bug fixes and code quality improvements from brutal-honest-review.

## Critical Fixes (9/10 completed, 1 deferred)

1. Fixed Agent Pattern Isolation (CRITICAL)
   - Added SwarmMemoryManager.queryPatternsByAgent()
   - SQL filtering by agent_id in metadata
   - Each agent now isolated

2. Fixed Async Method Cascade
   - Changed getPatterns() to async
   - Fixed 10 callers across 6 files
   - Build passes

3. Fixed Misleading Logging
   - Added isRealAgentDB() detection
   - Honest mock vs real reporting

4. Consolidated Embedding Generation
   - Created EmbeddingGenerator utility
   - Removed 50+ duplicate lines

5. Added AgentDB Initialization Checks
   - Empty DB detection
   - HNSW index verification

6. Integration Test Suite
   - 26 new test cases
   - Error path coverage

7. Repository Cleanup
   - Removed 19 temp test files

8. New QE Skill: sherlock-review
   - Evidence-based investigative review
   - 38 QE skills total

9. Deferred: Wire Up Real Test Execution
   - Deferred to v1.9.0 (documented)

## Statistics
- Fixes: 9/10 (90%, 1 deferred)
- Files Modified: 16
- Files Created: 3
- Files Deleted: 19
- Integration Tests: 26
- Build: PASSING

## Breaking Changes
- getPatterns() now async - add await

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-11-17 12:32:03 +00:00
Profa 25cb212c06 possible improvements 2025-11-15 16:42:35 +00:00