mirror of
https://github.com/ruvnet/ruflo.git
synced 2026-09-14 14:01:28 +08:00
rUv
dc8463872d
* docs: add ADR-057 — RVF native storage backend to replace sql.js Proposes replacing the 18MB sql.js WASM SQLite dependency with RuVector Format (RVF) across @claude-flow/shared, memory, and embeddings packages. Includes automatic and manual migration paths for existing .db and .json files with full backward compatibility. Key benefits: -18MB install size, 150x-12,500x faster vector search via native HNSW, quantization support, crash-safe append-only format. Co-Authored-By: claude-flow <ruv@ruv.net> * docs: extend ADR-057 with RVF embedding provider, ruvLLM persistence, and progressive download Add three major sections to ADR-057: - Section 3A: RVF as 5th EmbeddingProvider (52KB WASM replaces 540MB agentic-flow for basic use cases). Updated auto-select hierarchy: rvf > agentic-flow > transformers > mock. - Section 3B: ruvLLM learning persistence via RVF segments. SONA patterns (ReasoningBank), LoRA adapters, and EWC++ weights now survive process restarts. RuVectorProvider.searchMemory works offline via RVF without HTTP server. - Section 10: Progressive download architecture. Replaces npm optionalDependencies (all-or-nothing 1.3GB) with on-demand capability downloads stored as .rvf files. 5 phases from 22MB core CLI to full LLM/CNN/GNN/kernel capabilities. Implementation plan expanded from 5 to 8 phases. Testing strategy updated with 11 new test cases covering the additions. Co-Authored-By: claude-flow <ruv@ruv.net> * feat: add optimized Docker images for Ruflo lite/full/workers - Dockerfile: Multi-stage Alpine build with aggressive dependency pruning. Result: 324MB image, 0.6s startup (vs 1.3GB/35s baseline). Uses --omit=optional + explicit rm -rf of heavy transitive deps. - Dockerfile.full: Full image variant with all optional dependencies including native compilation (onnxruntime-node, better-sqlite3). - Dockerfile.headless: Updated from node:20 to node:22, claude-flow branding to ruflo, same prune strategy as lite. - docker-compose.yml: Three profiles (lite, full, workers) with appropriate resource limits and health checks. - .dockerignore: Excludes node_modules, tests, source maps, IDE configs, and secrets from build context. Co-Authored-By: claude-flow <ruv@ruv.net> * feat(ADR-057): implement RVF native storage backend across all packages Replace sql.js (18MB WASM) with zero-dependency RVF format across memory, events, embeddings, and learning subsystems. Pure TypeScript fallback with optional native @ruvector/rvf acceleration. New files: - memory/rvf-backend.ts: IMemoryBackend impl with HNSW + binary persistence - memory/hnsw-lite.ts: Lightweight HNSW graph for vector search - memory/rvf-learning-store.ts: SONA pattern/LoRA/EWC/trajectory persistence - memory/persistent-sona.ts: PersistentSonaCoordinator wrapping learning store - shared/events/rvf-event-log.ts: Append-only event log (replaces EventStore) - embeddings/rvf-embedding-cache.ts: Binary file embedding cache (FNV-1a keys) - embeddings/rvf-embedding-service.ts: Hash-based embedding provider (<0.1ms) Integrations: - DatabaseProvider: 'rvf' added, auto-selected first (always available) - EmbeddingProvider: 'rvf' added, auto-selected first in async factory - All packages export new RVF types and classes Tests: 163 passing (5 suites), validated in Docker (node:22-alpine) - rvf-backend: 50 tests (CRUD, query, search, persistence, HNSW) - rvf-event-log: 33 tests (append, replay, snapshots, crash recovery) - rvf-embeddings: 30 tests (cache, service, determinism, normalization) - rvf-learning-store: 31 tests (patterns, LoRA, EWC, trajectories) - rvf-integration: 19 tests (provider selection, migration, concurrency) Co-Authored-By: claude-flow <ruv@ruv.net> * fix(ADR-057): harden RVF storage with security, performance, and migration Security: atomic writes (tmp+rename) across all backends, path validation, input validation at boundaries. Performance: persist lock prevents concurrent flushes, stack overflow fix for large datasets, timer.unref() prevents hangs, O(1) eviction lookup in embedding cache. New: bidirectional RVF migration utility (JSON/SQLite/RVF), format v2 with backward compat, auto-persist patterns and trajectories before eviction. Added HnswLite and RvfMigrator exports. 193 tests passing, 0 TS errors. Refs #1242 Co-Authored-By: claude-flow <ruv@ruv.net> * fix: doctor version detection and init settings warnings (#1235, #1230) doctor: Replace unreliable path-walking heuristic with import.meta.url traversal to find the correct package.json. Removes stale npx cache scanning that could report wrong versions. Fixes #1235. init: Remove invalid TeammateIdle and TaskCompleted keys from generated .claude/settings.json hooks section. These are not recognized by Claude Code and caused warnings. Config remains available under the claudeFlow namespace. Fixes #1230. Co-Authored-By: claude-flow <ruv@ruv.net> * fix(doctor): remove Windows-incompatible shell redirects, simplify root detection - Remove fragile Windows root calculation (split on backslash); use dirname(dir) === dir instead which works on all platforms - Remove 2>/dev/null from npm view command (fails on Windows cmd.exe); the catch block handles errors gracefully already Co-Authored-By: claude-flow <ruv@ruv.net> * security: harden RVF against crafted files and race conditions - rvf-backend: validate dimensions (1-10000), validate RVF header structure and size before JSON.parse, guard persist interval against concurrent flushes - rvf-embedding-cache: use random suffix for tmp files to prevent predictable-path attacks on multi-user systems - rvf-event-log: add 100MB max payload size limit to prevent DoS from crafted event log files - rvf-migration: add null byte and type validation on all paths Co-Authored-By: claude-flow <ruv@ruv.net>
113 lines
4.0 KiB
Docker
113 lines
4.0 KiB
Docker
# Ruflo v3.5 — Headless Worker Image
|
|
# ADR-020: Headless Worker Integration Architecture - Phase 3
|
|
#
|
|
# Headless workers run CLI daemon in foreground without interactive terminal.
|
|
# Used by docker-compose.workers.yml for scalable worker pools.
|
|
#
|
|
# Build:
|
|
# docker build -t ruflo:headless -f v3/@claude-flow/cli/docker/Dockerfile.headless .
|
|
#
|
|
# Run:
|
|
# docker run -e ANTHROPIC_API_KEY=$ANTHROPIC_API_KEY ruflo:headless
|
|
|
|
# ── Stage 1: Install ─────────────────────────────────────────────
|
|
FROM node:22-alpine AS build
|
|
|
|
RUN apk add --no-cache git
|
|
|
|
WORKDIR /install
|
|
|
|
# Install ruflo with --omit=optional to skip heavy transitive deps
|
|
RUN npm install -g ruflo@latest \
|
|
--omit=optional \
|
|
--ignore-scripts \
|
|
--no-audit \
|
|
--no-fund \
|
|
&& npm cache clean --force
|
|
|
|
# Prune heavy optional transitive deps (CLI works without them)
|
|
RUN GLOBAL_PREFIX=$(npm config get prefix) \
|
|
&& CLI_NM="${GLOBAL_PREFIX}/lib/node_modules/ruflo/node_modules" \
|
|
&& rm -rf \
|
|
"${CLI_NM}/agentic-flow" \
|
|
"${CLI_NM}/@opentelemetry" \
|
|
"${CLI_NM}/onnxruntime-node" \
|
|
"${CLI_NM}/onnxruntime-web" \
|
|
"${CLI_NM}/onnx-proto" \
|
|
"${CLI_NM}/@anthropic-ai" \
|
|
"${CLI_NM}/@xenova" \
|
|
"${CLI_NM}/agentdb" \
|
|
"${CLI_NM}/@ruvector" \
|
|
"${CLI_NM}/ruvector" \
|
|
"${CLI_NM}/tiktoken" \
|
|
"${CLI_NM}/@img" \
|
|
"${CLI_NM}/better-sqlite3" \
|
|
"${CLI_NM}/sharp" \
|
|
"${CLI_NM}/@google" \
|
|
&& rm -rf \
|
|
"${CLI_NM}/@claude-flow/embeddings" \
|
|
"${CLI_NM}/@claude-flow/memory" \
|
|
"${CLI_NM}/@claude-flow/codex" \
|
|
"${CLI_NM}/@claude-flow/guidance" \
|
|
"${CLI_NM}/@claude-flow/aidefence" \
|
|
"${CLI_NM}/@claude-flow/plugin-gastown-bridge" \
|
|
&& NESTED="${CLI_NM}/@claude-flow/cli/node_modules" \
|
|
&& rm -rf \
|
|
"${NESTED}/agentic-flow" \
|
|
"${NESTED}/@ruvector" \
|
|
"${NESTED}/agentdb" \
|
|
&& rm -rf \
|
|
"${CLI_NM}/ruvector-onnx-embeddings-wasm" \
|
|
"${CLI_NM}/ruvector-core-linux-x64-gnu" \
|
|
"${CLI_NM}/@claude-flow/neural" \
|
|
"${CLI_NM}/@grpc" \
|
|
"${CLI_NM}/gun"
|
|
|
|
# Stage the pruned install for copying
|
|
RUN GLOBAL_PREFIX=$(npm config get prefix) \
|
|
&& mkdir -p /staged/lib /staged/bin \
|
|
&& cp -a "${GLOBAL_PREFIX}/lib/node_modules" /staged/lib/ \
|
|
&& cp -a "${GLOBAL_PREFIX}/bin/ruflo" /staged/bin/ 2>/dev/null || true \
|
|
&& cp -a "${GLOBAL_PREFIX}/bin/claude-flow" /staged/bin/ 2>/dev/null || true \
|
|
&& cp -a "${GLOBAL_PREFIX}/bin/cli" /staged/bin/ 2>/dev/null || true
|
|
|
|
# ── Stage 2: Production ──────────────────────────────────────────
|
|
FROM node:22-alpine AS production
|
|
|
|
RUN apk add --no-cache dumb-init git bash ca-certificates curl
|
|
|
|
# Non-root user
|
|
RUN addgroup -g 1001 -S ruflo \
|
|
&& adduser -S -D -H -u 1001 -h /home/ruflo -s /bin/bash -G ruflo ruflo \
|
|
&& mkdir -p /home/ruflo/.claude-flow /workspace /var/log/ruflo \
|
|
&& chown -R ruflo:ruflo /home/ruflo /workspace /var/log/ruflo
|
|
|
|
# Copy global node_modules and bin links from build stage
|
|
COPY --from=build /staged/lib/node_modules /usr/local/lib/node_modules
|
|
COPY --from=build /staged/bin/ /usr/local/bin/
|
|
|
|
# Ensure bin symlinks
|
|
RUN ln -sf /usr/local/lib/node_modules/ruflo/bin/ruflo.js /usr/local/bin/ruflo 2>/dev/null || true \
|
|
&& ln -sf /usr/local/lib/node_modules/@claude-flow/cli/bin/cli.js /usr/local/bin/claude-flow 2>/dev/null || true \
|
|
&& chmod +x /usr/local/bin/ruflo 2>/dev/null || true \
|
|
&& chmod +x /usr/local/bin/claude-flow 2>/dev/null || true
|
|
|
|
ENV NODE_ENV=production \
|
|
CLAUDE_CODE_HEADLESS=true \
|
|
CLAUDE_CODE_SANDBOX_MODE=strict \
|
|
CLAUDE_FLOW_LOG_LEVEL=info \
|
|
HOME=/home/ruflo
|
|
|
|
HEALTHCHECK --interval=30s --timeout=10s --start-period=30s --retries=3 \
|
|
CMD ruflo doctor --quiet || exit 1
|
|
|
|
USER ruflo
|
|
WORKDIR /workspace
|
|
|
|
EXPOSE 3000
|
|
|
|
ENTRYPOINT ["/usr/bin/dumb-init", "--"]
|
|
|
|
# Default: start daemon in headless foreground mode
|
|
CMD ["ruflo", "daemon", "start", "--foreground", "--headless"]
|