mirror of
https://github.com/ruvnet/ruflo.git
synced 2026-09-14 14:01:28 +08:00
rUv
dc8463872d
* docs: add ADR-057 — RVF native storage backend to replace sql.js Proposes replacing the 18MB sql.js WASM SQLite dependency with RuVector Format (RVF) across @claude-flow/shared, memory, and embeddings packages. Includes automatic and manual migration paths for existing .db and .json files with full backward compatibility. Key benefits: -18MB install size, 150x-12,500x faster vector search via native HNSW, quantization support, crash-safe append-only format. Co-Authored-By: claude-flow <ruv@ruv.net> * docs: extend ADR-057 with RVF embedding provider, ruvLLM persistence, and progressive download Add three major sections to ADR-057: - Section 3A: RVF as 5th EmbeddingProvider (52KB WASM replaces 540MB agentic-flow for basic use cases). Updated auto-select hierarchy: rvf > agentic-flow > transformers > mock. - Section 3B: ruvLLM learning persistence via RVF segments. SONA patterns (ReasoningBank), LoRA adapters, and EWC++ weights now survive process restarts. RuVectorProvider.searchMemory works offline via RVF without HTTP server. - Section 10: Progressive download architecture. Replaces npm optionalDependencies (all-or-nothing 1.3GB) with on-demand capability downloads stored as .rvf files. 5 phases from 22MB core CLI to full LLM/CNN/GNN/kernel capabilities. Implementation plan expanded from 5 to 8 phases. Testing strategy updated with 11 new test cases covering the additions. Co-Authored-By: claude-flow <ruv@ruv.net> * feat: add optimized Docker images for Ruflo lite/full/workers - Dockerfile: Multi-stage Alpine build with aggressive dependency pruning. Result: 324MB image, 0.6s startup (vs 1.3GB/35s baseline). Uses --omit=optional + explicit rm -rf of heavy transitive deps. - Dockerfile.full: Full image variant with all optional dependencies including native compilation (onnxruntime-node, better-sqlite3). - Dockerfile.headless: Updated from node:20 to node:22, claude-flow branding to ruflo, same prune strategy as lite. - docker-compose.yml: Three profiles (lite, full, workers) with appropriate resource limits and health checks. - .dockerignore: Excludes node_modules, tests, source maps, IDE configs, and secrets from build context. Co-Authored-By: claude-flow <ruv@ruv.net> * feat(ADR-057): implement RVF native storage backend across all packages Replace sql.js (18MB WASM) with zero-dependency RVF format across memory, events, embeddings, and learning subsystems. Pure TypeScript fallback with optional native @ruvector/rvf acceleration. New files: - memory/rvf-backend.ts: IMemoryBackend impl with HNSW + binary persistence - memory/hnsw-lite.ts: Lightweight HNSW graph for vector search - memory/rvf-learning-store.ts: SONA pattern/LoRA/EWC/trajectory persistence - memory/persistent-sona.ts: PersistentSonaCoordinator wrapping learning store - shared/events/rvf-event-log.ts: Append-only event log (replaces EventStore) - embeddings/rvf-embedding-cache.ts: Binary file embedding cache (FNV-1a keys) - embeddings/rvf-embedding-service.ts: Hash-based embedding provider (<0.1ms) Integrations: - DatabaseProvider: 'rvf' added, auto-selected first (always available) - EmbeddingProvider: 'rvf' added, auto-selected first in async factory - All packages export new RVF types and classes Tests: 163 passing (5 suites), validated in Docker (node:22-alpine) - rvf-backend: 50 tests (CRUD, query, search, persistence, HNSW) - rvf-event-log: 33 tests (append, replay, snapshots, crash recovery) - rvf-embeddings: 30 tests (cache, service, determinism, normalization) - rvf-learning-store: 31 tests (patterns, LoRA, EWC, trajectories) - rvf-integration: 19 tests (provider selection, migration, concurrency) Co-Authored-By: claude-flow <ruv@ruv.net> * fix(ADR-057): harden RVF storage with security, performance, and migration Security: atomic writes (tmp+rename) across all backends, path validation, input validation at boundaries. Performance: persist lock prevents concurrent flushes, stack overflow fix for large datasets, timer.unref() prevents hangs, O(1) eviction lookup in embedding cache. New: bidirectional RVF migration utility (JSON/SQLite/RVF), format v2 with backward compat, auto-persist patterns and trajectories before eviction. Added HnswLite and RvfMigrator exports. 193 tests passing, 0 TS errors. Refs #1242 Co-Authored-By: claude-flow <ruv@ruv.net> * fix: doctor version detection and init settings warnings (#1235, #1230) doctor: Replace unreliable path-walking heuristic with import.meta.url traversal to find the correct package.json. Removes stale npx cache scanning that could report wrong versions. Fixes #1235. init: Remove invalid TeammateIdle and TaskCompleted keys from generated .claude/settings.json hooks section. These are not recognized by Claude Code and caused warnings. Config remains available under the claudeFlow namespace. Fixes #1230. Co-Authored-By: claude-flow <ruv@ruv.net> * fix(doctor): remove Windows-incompatible shell redirects, simplify root detection - Remove fragile Windows root calculation (split on backslash); use dirname(dir) === dir instead which works on all platforms - Remove 2>/dev/null from npm view command (fails on Windows cmd.exe); the catch block handles errors gracefully already Co-Authored-By: claude-flow <ruv@ruv.net> * security: harden RVF against crafted files and race conditions - rvf-backend: validate dimensions (1-10000), validate RVF header structure and size before JSON.parse, guard persist interval against concurrent flushes - rvf-embedding-cache: use random suffix for tmp files to prevent predictable-path attacks on multi-user systems - rvf-event-log: add 100MB max payload size limit to prevent DoS from crafted event log files - rvf-migration: add null byte and type validation on all paths Co-Authored-By: claude-flow <ruv@ruv.net>
118 lines
3.4 KiB
YAML
118 lines
3.4 KiB
YAML
# Ruflo v3.5 — Docker Compose Profiles
|
|
#
|
|
# Profiles:
|
|
# lite — MCP server only (stdio), minimal footprint
|
|
# full — CLI + daemon + all optional deps
|
|
# workers — Scalable worker pool (extends docker-compose.workers.yml)
|
|
#
|
|
# Usage:
|
|
# docker compose -f v3/@claude-flow/cli/docker/docker-compose.yml --profile lite up
|
|
# docker compose -f v3/@claude-flow/cli/docker/docker-compose.yml --profile full up -d
|
|
# docker compose -f v3/@claude-flow/cli/docker/docker-compose.yml --profile workers up -d --scale worker=5
|
|
#
|
|
# Environment (required for full/workers):
|
|
# ANTHROPIC_API_KEY — Your Anthropic API key
|
|
|
|
services:
|
|
# ── lite: MCP server on stdio (~80MB) ──────────────────────────
|
|
mcp:
|
|
profiles: ["lite"]
|
|
build:
|
|
context: ../../../..
|
|
dockerfile: v3/@claude-flow/cli/docker/Dockerfile
|
|
image: ruflo:lite
|
|
stdin_open: true
|
|
environment:
|
|
- NODE_ENV=production
|
|
- CLAUDE_FLOW_MCP_TRANSPORT=stdio
|
|
deploy:
|
|
resources:
|
|
limits:
|
|
cpus: "1"
|
|
memory: 512M
|
|
reservations:
|
|
cpus: "0.25"
|
|
memory: 128M
|
|
healthcheck:
|
|
test: ["CMD", "ruflo", "doctor", "--quiet"]
|
|
interval: 30s
|
|
timeout: 10s
|
|
retries: 3
|
|
start_period: 10s
|
|
|
|
# ── full: CLI + daemon + optional deps (~800MB) ────────────────
|
|
ruflo-full:
|
|
profiles: ["full"]
|
|
build:
|
|
context: ../../../..
|
|
dockerfile: v3/@claude-flow/cli/docker/Dockerfile.full
|
|
image: ruflo:full
|
|
environment:
|
|
- ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY}
|
|
- NODE_ENV=production
|
|
- CLAUDE_FLOW_LOG_LEVEL=${CLAUDE_FLOW_LOG_LEVEL:-info}
|
|
- CLAUDE_FLOW_MEMORY_BACKEND=hybrid
|
|
volumes:
|
|
- ruflo-state:/home/ruflo/.claude-flow
|
|
- ruflo-logs:/var/log/ruflo
|
|
ports:
|
|
- "${RUFLO_MCP_PORT:-3000}:3000"
|
|
deploy:
|
|
resources:
|
|
limits:
|
|
cpus: "4"
|
|
memory: 8G
|
|
reservations:
|
|
cpus: "1"
|
|
memory: 2G
|
|
command: ["ruflo", "daemon", "start", "--foreground"]
|
|
healthcheck:
|
|
test: ["CMD", "ruflo", "doctor", "--quiet"]
|
|
interval: 30s
|
|
timeout: 10s
|
|
retries: 3
|
|
start_period: 30s
|
|
|
|
# ── workers: Scalable worker pool ──────────────────────────────
|
|
worker:
|
|
profiles: ["workers"]
|
|
build:
|
|
context: ../../../..
|
|
dockerfile: v3/@claude-flow/cli/docker/Dockerfile
|
|
image: ruflo:lite
|
|
environment:
|
|
- ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY}
|
|
- CLAUDE_CODE_HEADLESS=true
|
|
- CLAUDE_CODE_SANDBOX_MODE=${CLAUDE_FLOW_SANDBOX:-strict}
|
|
- CLAUDE_FLOW_WORKERS=${CLAUDE_FLOW_WORKERS:-audit,optimize,testgaps}
|
|
- NODE_ENV=production
|
|
volumes:
|
|
- worker-state:/home/ruflo/.claude-flow
|
|
- worker-logs:/var/log/ruflo
|
|
deploy:
|
|
replicas: ${RUFLO_WORKER_REPLICAS:-3}
|
|
resources:
|
|
limits:
|
|
cpus: "2"
|
|
memory: 4G
|
|
reservations:
|
|
cpus: "0.5"
|
|
memory: 1G
|
|
restart_policy:
|
|
condition: on-failure
|
|
delay: 5s
|
|
max_attempts: 3
|
|
command: ["ruflo", "daemon", "start", "--foreground", "--headless"]
|
|
healthcheck:
|
|
test: ["CMD", "ruflo", "doctor", "--quiet"]
|
|
interval: 30s
|
|
timeout: 10s
|
|
retries: 3
|
|
start_period: 30s
|
|
|
|
volumes:
|
|
ruflo-state:
|
|
ruflo-logs:
|
|
worker-state:
|
|
worker-logs:
|