mirror of
https://github.com/ruvnet/ruflo.git
synced 2026-09-14 14:01:28 +08:00
b395d12559
Full benchmark implementation to evaluate AgentDB memory system against the LongMemEval standard (ICLR 2025, 500 questions, 6 categories). Includes: - ADR-088 with competitive landscape analysis (MemPalace 96.6%, OMEGA 95.4%, Observational Memory 94.87%) - Benchmark harness with 4 modes: raw, hybrid, full, baseline - AgentDB adapter (HNSW + ONNX) and baseline adapter (cosine) - Dataset download scripts (HuggingFace) - Per-category scoring, latency percentiles, storage metrics - Honesty protocol: no test-set tuning, full category breakdown Motivated by MemPalace's claimed "perfect score" — we need a real apples-to-apples comparison to establish AgentDB's position. Co-authored-by: Reuven <cohen@ruv-mac-mini.local>