* docs(positioning): wave 1 — README hero rewrite to wiki framing (soc-nybd)
Apply the locked decisions D1–D10 from the positioning doc-sweep packet:
- D1 headline: "A wiki for your agents. Built so you own the moat."
- D2 wiki-framing opener; D3 moat statement + "shovel" anchor
- D4 non-positioning ("AgentOps is not a coding harness")
- D5 receipts block (timestamped 2026-05-04 stable snapshot)
- D6 enterprise-pattern statement (pattern claim, no company names)
- D7 "What if the labs ship this natively?" section before Contributing
- D8 Notion vs AgentOps comparison table (7 rows)
- D9 SE → Context translation table (11 rows) replacing prior SDLC/CDLC table
- D10 line budget: 420 → 295 lines
Drops: intra-page nav bar, Validate/Nightly badges (stars retained),
"Competitive Positioning" section, 12-Factor Doctrine 4-tier table (now
single sentence linking 12factoragentops.com), mermaid diagram, AOP-CLAIM
markers, cross-runtime <details> block.
Forward references to docs/wiki-for-agents.md and docs/trust-factory.md
will resolve when Wave 4 lands those new files.
Source: .agents/discovery/2026-05-07-positioning-doc-sweep.md
Epic: soc-9xn0
* docs(positioning): wave 2 — strategic doc alignment to wiki framing (soc-ylp9, soc-rnbf, soc-x3b6, soc-b1r3)
Align PRODUCT.md, GOALS.md, docs/index.md, docs/agentops-brief.md with
the README's locked positioning thesis.
PRODUCT.md (soc-ylp9):
- Mission opener: wiki framing replaces "keeps the books / compiles the
context / compounds the corpus"
- "What the Product Actually Is" leads with wiki framing before four-layer model
- New "What if the labs ship this natively?" section (D7 verbatim with
"Anthropic's Managed Agents")
- Evidence section timestamped: corpus wipe on 2026-05-07, durability fix
tracked in soc-rv5p
- Cross-links to docs/trust-factory.md (forward to Wave 4)
- last_reviewed: 2026-05-06 → 2026-05-07
GOALS.md (soc-rnbf):
- Lede: "A wiki for your agents — repo-native, version-controlled,
mechanically maintained"
- New North Star: "The wiki maintains itself: every session contributes to
.agents/ by default"
- New directive #11: corpus durability (tag corpus-state, soc-rv5p)
- All 10 prior directives preserved
docs/index.md (soc-x3b6):
- Hero rebuilt: D1 headline + subhead + D2 wiki framing + D3 italicized
moat + "AgentOps is the shovel. Start digging."
- mkdocs hero buttons (Install / See It Work / GitHub) preserved
- Body sections unchanged
docs/agentops-brief.md (soc-b1r3):
- Opener swapped to D2 + D3 (wiki framing + shovel anchor)
- New "What if the labs ship this natively?" paragraph (D7 verbatim)
- See-also forward links to docs/trust-factory.md, docs/wiki-for-agents.md
Source: .agents/discovery/2026-05-07-positioning-doc-sweep.md
Epic: soc-9xn0
* docs(comparisons): wave 3 — comparison surface refresh + 2 new lane docs
Refresh 3 existing comparison docs to current competitive state and add
2 new comparison docs covering volume-marketplace and cross-harness lanes.
Refresh:
- competitive-radar.md (soc-33kk): 7-competitor lane table, 6 differentiators
(persistent corpus, off-API daemon, multi-model council, model-independent
phase routing, context-engineering vocabulary, honest empirical disclosure),
5-lane segmentation, last_reviewed → 2026-05-07
- vs-compound-engineer.md (soc-al8s): CE current state (37 skills/51 agents/
7-phase/10-target), new model-independent phase routing row, last_reviewed
added
- vs-superpowers.md (soc-zhig): Anthropic marketplace fact, 29K+ stars, wiki
framing in cross-session memory section (25-year-old idea), last_reviewed
added
NEW:
- vs-tons-of-skills.md (soc-fmkw): volume-marketplace lane comparison —
Tons-of-Skills (425 plugins, 2,810 skills, 200 agents, CCPI grading) vs
AgentOps as different categories. 90 lines.
- vs-everything-claude-code.md (soc-jhtu): cross-harness-parity lane
comparison — everything-claude-code (48 subagents, 182 skills, 5-runtime
DRY parity) vs AgentOps's per-phase model routing. Includes credibility-
move flag on the unverified 140K+ stars / 21K+ forks claim. 181 lines.
Source: .agents/discovery/2026-05-07-positioning-doc-sweep.md, council
research at .agents/council/2026-05-07-research-readme-positioning.md
Epic: soc-9xn0
* docs(positioning): wave 4 — bridge docs + index update (soc-momx, soc-envj, soc-e031)
Two new bridge documents that complete the positioning surface, plus the
documentation index update to make all 4 new docs reachable.
NEW docs/trust-factory.md (soc-momx, 112 lines, 854 words):
The 5-step trust-factory primitive (Identity → Reproducibility → Evaluation
→ Evidence → Recovery) mapped to AgentOps mechanisms. Bridge document for
engineering leads in regulated environments who think in trust-factory
vocabulary already. Pairs with the wiki framing as the alternative buyer
view.
NEW docs/wiki-for-agents.md (soc-envj, 93 lines, 824 words):
Standalone wiki framing — "wikis aren't new, the novel part is making the
discipline mechanical so it actually happens." Uses the D8 Notion comparison
table verbatim, covers the .agents/ directory layout, and explains why most
wikis fail (write-tax + bitrot) and how AgentOps inverts the pattern.
docs/documentation-index.md (soc-e031):
- Added "Bridge / framing docs" sub-list under Four Product Layers with
trust-factory.md and wiki-for-agents.md (visible above the fold)
- Added vs-tons-of-skills.md and vs-everything-claude-code.md to existing
Comparisons section (alphabetical with other vs-* entries)
- 222 → 226 entries; 309 → 316 lines
Source: .agents/discovery/2026-05-07-positioning-doc-sweep.md
Epic: soc-9xn0
* docs(positioning): wave 5 — body doc cross-links + light framing align (soc-igqq, soc-chkd, soc-cout)
Light touch on three linked body docs to align with the wiki framing
without restructuring their substance.
docs/cdlc.md (soc-igqq):
- Lede leads with "Software engineering took 50 years..." + the 11-row
SE→Context translation table (D9 verbatim)
- "CDLC" acronym deferred to body intro after the table establishes the
concept (acronym kept in 11+ body uses)
- Companion docs section cross-links to wiki-for-agents.md, trust-factory.md
- 248 → 273 lines
docs/the-science.md (soc-chkd):
- Practitioner-facing pointer under TL;DR: "see [Trust Factory]" +
"[A wiki for your agents]"
- Companion docs section
- 671 → 678 lines, science content intact
docs/positioning/devops-for-vibe-coding.md (soc-cout):
- Primary tagline → wiki framing ("A wiki for your agents — built so you
own the moat"); secondary recast as DevOps-lineage tagline
- Category line acknowledges DevOps lineage as historical, not category label
- Date 2026-01-31 → 2026-05-07; version 1.2.0 → 1.3.0
- Cross-link to ../wiki-for-agents.md
- DevOps argument preserved (14 DevOps mentions intact, 6-differentiators
table untouched)
- 343 → 351 lines
Source: .agents/discovery/2026-05-07-positioning-doc-sweep.md
Epic: soc-9xn0
* docs(positioning): wave 6 — fix mkdocs --strict link warnings (soc-uc3w)
The wave 4 bridge docs and wave 3 competitive-radar refresh used relative
links that escape the mkdocs docs/ tree:
- ../README.md and ../PRODUCT.md cross-links → switched to absolute
https://github.com/boshu2/agentops/blob/main/{README,PRODUCT}.md
(matches existing docs/documentation-index.md convention)
- ../../.agents/council/ research link → demoted to plain-text path
reference (the .agents/ tree is gitignored runtime state, not a
publishable doc surface)
Verified: scripts/docs-build.sh --check now exits 0 with "OK: mkdocs
build --strict passed". Five strict-mode warnings cleared.
Wave 6 validation results (12-item checklist):
- mkdocs --strict: PASS
- competitive-freshness: PASS (8/8 docs ≤45 days)
- README ≤ 300: 295 lines
- D1-D10 visible across README, PRODUCT, GOALS, docs/index, docs/agentops-brief, docs/wiki-for-agents
- Cross-links: README→{wiki-for-agents, trust-factory}, PRODUCT→{trust-factory, wiki-for-agents}
- New comparison docs (vs-tons-of-skills, vs-everything-claude-code) exist
and are linked from competitive-radar.md and documentation-index.md
- "operational discipline" residues are historical-only (release notes,
origin-story, devops-for-vibe-coding messaging hierarchy)
Note: ao goals measure shows ambient fails unrelated to this sweep — the
tool is cwd-sensitive and reports "No such file or directory" for scripts
that exist (separate bug, not introduced by this work).
Source: .agents/discovery/2026-05-07-positioning-doc-sweep.md
Epic: soc-9xn0
33 KiB
The Science Behind AgentOps
TL;DR: One model of knowledge decay (Darr 1995) suggests ~17%/week without reinforcement. Knowledge compounds when retrieval × usage beats decay and scale friction. Early growth can be exponential; long-run growth requires active limits-to-growth controls.
For the practitioner-facing distillation, see Trust Factory. For the wiki framing of the same mechanism, see A wiki for your agents.
Companion docs
- Trust Factory — the practitioner-facing distillation: how the science maps to identity, reproducibility, evaluation, evidence, and recovery.
- A wiki for your agents — the deflationary framing for the same mechanism (
.agents/as a 25-year-old idea, mechanically maintained).
The Journey
This wasn't designed in a vacuum. It came from years of connecting dots across fields:
- Knowledge OS — The insight that git + files can become a durable bookkeeping substrate
- DevOps — The Three Ways applied to knowledge, not just code
- Cognitive Science — Why 40% load is optimal (35 years of research)
- MemRL — Reinforcement learning for retrieval and utility-scoring systems (2026)
- Thermodynamics — The Brownian Ratchet as progress model
Each piece validated the intuition. The math fell out naturally.
Claim Status (So We Don't Overclaim)
To make this model durable under critique, we separate claim types:
| Tier | Claim Type | Standard of Evidence | Examples in this doc |
|---|---|---|---|
| A | Established external evidence | Peer-reviewed or widely replicated findings | Forgetting curves, cognitive load limits, lost-in-the-middle behavior |
| B | Internal empirical evidence | Reproducible internal measurements with clear methodology | Time-to-resolution deltas, token-cost deltas, reuse-rate trends |
| C | Working hypothesis | Mechanistic proposal under active testing | Ratchet model details, exact operating point for σ × ρ, cross-project transfer effects |
This document mixes all three tiers. The goal is to make each claim explicit, measurable, and falsifiable.
Part 1: The Problem (With Evidence)
Knowledge Decays. Fast.
Citation: Darr, E. D., Argote, L., & Epple, D. (1995). "The Acquisition, Transfer, and Depreciation of Knowledge in Service Organizations: Productivity in Franchises." Management Science, 41(11), 1750-1762.
Finding: Organizational knowledge depreciates at approximately 17% per week without active reinforcement.
Week 0: 100%
Week 1: 83% (lost 17%)
Week 2: 69% (lost another 17% of what remained)
Week 4: 47%
Week 8: 22%
Why this matters for AI: Every Claude session starts close to Week 0 unless the environment resurfaces prior work. Without bookkeeping plus retrieval, you're always on the left side of the decay curve.
The Forgetting Curve
Citation: Ebbinghaus, H. (1885). Über das Gedächtnis (Memory: A Contribution to Experimental Psychology).
Ebbinghaus discovered that memory decays exponentially without reinforcement, but each retrieval strengthens the memory and slows future decay.
Memory Strength
│
100%│╲
│ ╲
50%│ ╲______ retrieval here
│ ╲_____ slows decay
25%│ ╲____
└─────────────────────────
Time →
The insight: It's not about storing more. It's about retrieving at the right time.
Part 2: The Math (Plain English)
The Equation
dK/dt = I(t) - δ·K + σ·ρ·K
Don't panic. Here's what each piece means:
| Symbol | What It Is | Plain English | Example |
|---|---|---|---|
K |
Knowledge stock | How much useful stuff you've accumulated | "We have 156 learnings stored" |
dK/dt |
Rate of change | Is the pile growing or shrinking? | "+5 learnings this week" or "-10 lost to decay" |
I(t) |
Input rate | New knowledge coming in | "Forged 3 sessions today" |
δ |
Decay rate | How fast you forget (0.17/week) | "17% gone each week if unused" |
σ |
Retrieval coverage | How much of the useful stock are you actually surfacing? | "Surfaced 70% of retrievable artifacts" |
ρ |
Decision influence rate | Of what you surfaced, how much later had evidence-backed use? | "30% of surfaced artifacts were referenced or applied" |
Implementation note: In the CLI implementation (
metrics_health.go), sigma measures unique surfaced retrievable artifacts / total retrievable artifacts over the last 10 sessions, rho measures the fraction of surfaced artifacts later evidenced byreferenceorappliedcitations, and delta measures average age of active learnings in days. The escape velocity check usesσ × ρ > δ/100to normalize delta to a ratio comparable with sigma and rho.
Dimensional Check
To keep this scientifically defensible:
Kis measured in useful knowledge units (for example: validated learnings).I(t)is knowledge units per week.δ,σ, andρare rates/probabilities per week or per retrieval cycle.- All terms in
dK/dtresolve to knowledge units per week.
Breaking It Down
I(t) — The input. You forge transcripts, extract learnings, write retros. Knowledge goes in.
- δ·K — The decay. Every week, 17% of your knowledge becomes stale or forgotten. This is fighting against you.
+ σ·ρ·K — The compounding term. This is the magic.
When you retrieve knowledge (σ) and actually use it (ρ), two things happen:
- That knowledge gets reinforced (Ebbinghaus)
- New knowledge is created from the application
The ·K means it's proportional to how much you already have. More knowledge → more compounding.
System Dynamics Correction: Limits to Growth
The baseline equation is structurally correct, but idealized. In real systems, reinforcing loops hit balancing loops at scale.
A scale-aware form:
dK/dt = I(t) - δ·K + σ(K,t)·ρ·K - φ·K²
where:
σ(K,t) = σ_max / (1 + (K / Kσ)^n)
Interpretation:
σ(K,t)declines as the corpus grows unless retrieval/index quality improves.φ·K²captures scale friction: indexing overhead, latency, noise, governance cost, and cognitive overhead.Kσis the knowledge scale where retrieval starts degrading materially.
This adds the missing Limits to Growth balancing loop from System Dynamics.
The Escape Velocity Condition
Rearrange the equation at steady state:
General growth condition:
I(t) + K(σ·ρ - δ) > 0
Operational self-sustaining check: σ × ρ > δ/100
With scale friction:
ρ·σ(K,t) > δ/100 + φ·K - I(t)/K
Meaning: early growth can be exponential, but long-run growth plateaus unless you actively prevent σ collapse and friction growth.
If your retrieval effectiveness times your citation rate exceeds 0.17 in self-sustaining mode, you're compounding. If not, you either need fresh input I(t) or stronger controls to avoid stagnation.
| Scenario | σ | ρ | σ × ρ | vs δ | Result |
|---|---|---|---|---|---|
| No bookkeeping or retrieval | 0 | 0 | 0 | < 0.17 | Decaying |
| Store but don't retrieve | 0.1 | 0.1 | 0.01 | < 0.17 | Decaying |
| Retrieve but don't use | 0.8 | 0.1 | 0.08 | < 0.17 | Decaying |
| AgentOps target | 0.7 | 0.3 | 0.21 | > 0.17 | Compounding |
The 0.04 margin matters. Small edge, compounded over time, becomes massive.
Loop-Dominance Translation (System Dynamics)
This model is a stock-and-flow system with competing loops:
R1reinforcing loop: retrieval -> usage -> stronger priors -> better future retrieval.B1balancing loop: decay/staleness drains the stock.B2balancing loop: scale friction reduces retrieval and increases operating cost asKgrows.
Expected phases:
- Bootstrap phase:
R1 > B1, rapid gains. - Flywheel phase:
R1 > B1 + B2, compounding with healthy margins. - Saturation risk:
B2grows; gains flatten. - Renewal phase: pruning, re-indexing, tiering, and stronger feedback push
R1back above balancing loops.
Part 3: DevOps Foundation (The Three Ways)
Citation: Kim, G., Humble, J., Debois, P., & Willis, J. (2016). The DevOps Handbook. IT Revolution Press.
DevOps isn't about tools. It's about three principles:
The First Way: Flow
Optimize the flow of work from left to right (dev → ops → customer).
In AgentOps: Knowledge flows from sessions → forge → store → inject → next session.
Session → Forge → Store → Inject → Session
↓
(no bottlenecks)
We don't batch. We stream. Every session feeds the next.
The Second Way: Feedback
Create feedback loops at every stage.
In AgentOps:
/vibevalidates code quality/pre-mortemcatches failures before they happenao feedbacktrains the utility scorer- Citation tracking shows what's actually used
Action → Measurement → Learning → Adjustment
↑ │
└──────────────────────────────────┘
The Third Way: Continuous Learning
Create a culture of experimentation and learning from failure.
In AgentOps:
/retroextracts learnings from every significant work/post-mortemcloses the loop on epics- Failures become learnings, not just incidents
Failure → Retro → Learning → Pattern → Skill
↓
(never make same mistake)
The connection: DevOps optimizes code flow. AgentOps optimizes knowledge flow. Same principles, different domain.
Part 4: Cognitive Science (Why 40%)
The Research Stack
| Researcher | Year | Finding | Application |
|---|---|---|---|
| Miller | 1956 | Working memory holds 7±2 chunks | Context windows have real limits |
| Cowan | 2001 | Core capacity is ~4 items | Optimal load is lower than max |
| Sweller | 1988 | Cognitive Load Theory | Three types of load compete |
| Paas & van Merriënboer | 2020 | Updated CLT | JIT loading reduces extraneous load |
| Barkley | 2015 | Executive function limits | Performance collapses at overload |
| Csikszentmihalyi | 1990 | Flow state | Optimal challenge zone |
| Yerkes & Dodson | 1908 | Inverted-U performance curve | Peak at moderate arousal |
| Liu et al. | 2023 | "Lost in the Middle" | LLMs can't retrieve from crowded contexts |
Citations:
- Miller, G. A. (1956). "The magical number seven, plus or minus two." Psychological Review, 63(2), 81-97.
- Cowan, N. (2001). "The magical number 4 in short-term memory." Behavioral and Brain Sciences, 24(1), 87-114.
- Sweller, J. (1988). "Cognitive load during problem solving." Cognitive Science, 12(2), 257-285.
- Paas, F., & van Merriënboer, J. J. (2020). "Cognitive-load theory: Methods to manage working memory load." Current Directions in Psychological Science, 29(4), 394-398.
- Liu, N. F., et al. (2023). "Lost in the Middle: How Language Models Use Long Contexts." arXiv:2307.03172.
The Pattern
Every study finds the same thing: performance peaks at moderate load.
Performance
│
100%│ ╭───╮
│ ╭─╯ ╰─╮
75%│ ╭─╯ ╰─╮
│ ╭─╯ ╰─╮ collapse
50%│ ╭─╯ ╰──────
│╭─╯
25%│
└────────────────────────────────
0% 20% 40% 60% 80% 100%
Context Utilization
40% isn't arbitrary. It's where decades of research say performance lives.
Why This Matters for LLMs
Liu et al. (2023) showed that LLMs have a "lost in the middle" problem. When context is crowded:
- Information at the start: retrieved well
- Information at the end: retrieved well
- Information in the middle: lost
Retrieval Accuracy by Position:
Start │████████████████████│ High
│ │
Mid │████████░░░░░░░░░░░░│ Low ← "Lost in the middle"
│ │
End │████████████████████│ High
The fix: Don't fill context to 100%. Stay at 40%. The middle stays findable.
Part 5: MemRL (Scale-Control Mechanism)
Citation: Zhang, S., Wang, J., Zhou, R., et al. (2025). "MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memory." arXiv:2601.03192. https://arxiv.org/abs/2601.03192
The Problem MemRL Solves
Traditional retrieval uses recency or similarity. But not all knowledge is equally useful.
Traditional RAG:
Query → Find similar → Return top K → Hope it helps
Problem: Recent ≠ Useful. Similar ≠ Helpful.
The MemRL Solution
Use reinforcement learning to learn what's actually useful:
# Each piece of knowledge has a utility score
utility = 0.5 # Start neutral
# When retrieved and used successfully
utility = (1 - α) × utility + α × 1.0 # Reward
# When retrieved but not helpful
utility = (1 - α) × utility + α × 0.0 # Penalty
# Ranking combines freshness AND utility
score = z_norm(freshness) + λ × z_norm(utility)
The insight: The system learns from feedback. Over time, useful knowledge rises and noise sinks, which helps prevent σ from collapsing as K grows.
How We Use It
# User gives feedback
ao feedback L15 --reward 1.0 # "This learning was helpful"
ao feedback L12 --reward 0.0 # "This was irrelevant"
# System updates utility scores
# Future retrieval ranks by usefulness, not just recency
The math connection: MemRL is one practical control to keep σ(K,t) high enough to offset scale friction. It is a mechanism, not a guarantee.
Part 6: The Brownian Ratchet (Our Contribution)
The Physics
A Brownian ratchet is a thought experiment from thermodynamics:
- Molecules bounce randomly (thermal motion)
- A pawl allows motion in only one direction (one-way gate)
- Net result: forward movement from random chaos
Random Motion One-Way Gate Net Progress
↓ ↓ ↓
←→←→←→←→ ───────┤► ──────────►
(chaos) (filter) (ratchet)
The Software Analog
| Physics | Software | Example |
|---|---|---|
| Random motion | Multiple parallel attempts | 4 polecats trying different approaches |
| One-way gate | Validation gates | Tests, CI, /vibe, /pre-mortem |
| Net forward movement | Merged/locked progress | Code in main, issues closed, learnings stored |
Why This Model Matters
Traditional thinking: Minimize variance. One developer, one approach, careful steps.
Ratchet thinking: Maximize controlled variance. Many attempts, filter aggressively, lock successes.
Traditional:
───────────────────────────────────► (slow, fragile)
Ratchet:
═══╦═══╦═══╦═══╗
═══╬═══╬═══╬═══╬════════════════════► (fast, resilient)
═══╩═══╩═══╩═══╝
↑
some fail, most succeed
failures are cheap
The Key Property
You can always add more chaos. You can't un-ratchet.
- Failed experiment? Try another. (Chaos is cheap.)
- Merged code? It is hard to regress accidentally. (Ratchet holds.)
- Stored learning? It compounds if retrieval quality stays high. (Progress can lock, but scale can still add drag.)
This is why progress can be made one-way at the artifact level, while system-level growth still needs active scale management.
Part 7: Putting It All Together
The Full Picture
┌─────────────────────────────────────────────────────────────────┐
│ THE AGENTOPS SYSTEM │
├─────────────────────────────────────────────────────────────────┤
│ │
│ DEVOPS LAYER (The Three Ways) │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ Flow: Session → Forge → Store → Inject → Session │ │
│ │ Feedback: Vibe, Pre-mortem, Citations, Utility scores │ │
│ │ Learning: Retros, Post-mortems, Pattern extraction │ │
│ └─────────────────────────────────────────────────────────┘ │
│ │ │
│ ▼ │
│ COGNITIVE LAYER (40% Rule) │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ Context utilization: 35% checkpoint, 40% alert │ │
│ │ JIT loading: Load what's needed, when it's needed │ │
│ │ Lost-in-middle prevention: Don't crowd the context │ │
│ └─────────────────────────────────────────────────────────┘ │
│ │ │
│ ▼ │
│ MEMRL LAYER (Utility Learning) │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ Feedback loop: Use → Reward/Penalize → Update utility │ │
│ │ Retrieval: Freshness + Utility scoring │ │
│ │ Result: σ (retrieval effectiveness) improves over time │ │
│ └─────────────────────────────────────────────────────────┘ │
│ │ │
│ ▼ │
│ RATCHET LAYER (Progress Locking) │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ Chaos: Multiple attempts, parallel exploration │ │
│ │ Filter: Validation gates (tests, vibe, CI) │ │
│ │ Ratchet: Merge, close, store (permanent) │ │
│ └─────────────────────────────────────────────────────────┘ │
│ │ │
│ ▼ │
│ THE GOAL (Escape Velocity) │
│ ┌──────────────────────────────────────────────────────────┐ │
│ │ │ │
│ │ σ × ρ > δ/100 │ │
│ │ │ │
│ │ retrieval × evidence-backed use > aging threshold │ │
│ │ │ │
│ │ When true: KNOWLEDGE COMPOUNDS │ │
│ │ │ │
│ └──────────────────────────────────────────────────────────┘ │
│ │
└─────────────────────────────────────────────────────────────────┘
Why Each Piece Matters
| Layer | What It Does | Which Variable It Improves |
|---|---|---|
| DevOps | Flow, feedback, learning | I(t) — more knowledge in |
| Cognitive | Optimal load | σ — better retrieval |
| MemRL | Utility learning | σ — smarter retrieval |
| Scale controls (tiering/pruning/indexing) | Limits-to-growth mitigation | Holds σ(K,t) up and φ down |
| Ratchet | Lock progress | Prevents regression of K |
Every layer serves the equation. The added constraint is explicit: long-run growth needs scale controls, not just early flywheel activation.
Part 8: Evidence (Internal Pilots, Not Causal Proof Yet)
What We've Measured So Far
These are internal observations and should be read as Tier B evidence (operational telemetry, not randomized causal proof):
| Metric | Baseline (internal) | AgentOps condition (internal) | Direction |
|---|---|---|---|
| Same-issue resolution | 45 min | 3 min | Faster |
| Token cost per issue | $2.40 | $0.15 | Lower |
| Context collapse rate | ~65% at 60% load | 0% at 40% load | Lower |
| Knowledge reuse | ~0% | ~15% (growing) | Higher |
Why This Is Not Yet "Proof"
- Baselines are historical, not fully randomized.
- Team maturity and task mix can confound outcomes.
- Some gains can come from process discipline independent of memory quality.
Evaluation Design to Make It Bulletproof
For causal confidence, run a controlled protocol:
- Randomize comparable tasks across conditions (
memory-on,memory-off,memory-on + utility learning). - Pre-register primary metrics: resolution time, token cost, defect rate, reuse precision@k, and citation rate
ρ. - Track estimated decay
δ_tand retrieval effectivenessσ_tweekly. - Segment by corpus size (
Kbuckets) to detect limits-to-growth behavior. - Require out-of-sample replication across projects, not just one team.
Falsifiable Predictions
The model should be treated as wrong if repeated experiments show:
ρ·σ(K,t) <= δ + φ·K - I(t)/Kwhile performance still compounds.- Retrieval quality does not degrade with scale and no compensating controls are needed.
memory-on + utility learningdoes not outperformmemory-onasKincreases.- Gains disappear under simple task-randomized comparisons.
Part 9: Limits to Growth and Control Policy
System Dynamics says reinforcing loops eventually hit balancing loops. We model that explicitly and design around it.
Main Scale Risks
| Risk | Loop Effect | Observable Symptom |
|---|---|---|
| Corpus bloat | Lowers σ(K,t) |
Falling precision@k, more irrelevant recalls |
| Retrieval latency/cost | Raises effective φ |
Slower sessions, rising token burn |
| Quality drift | Raises effective δ |
More stale/contradictory learnings |
| Cognitive overload | Lowers ρ |
Retrieved items cited less in final outputs |
Control Actions (Operational)
| Control | Primary Variable | Practical Mechanism |
|---|---|---|
| Tiering + archival | φ down |
Keep hot set small, cold set searchable |
| Utility-based pruning | σ up, δ down |
Remove low-value or stale memories |
| Re-index + embedding refresh | σ up |
Improve retrieval quality as schema evolves |
| Citation incentives/UX | ρ up |
Make reuse cheaper than re-derivation |
| Drift audits | δ down |
Detect and repair stale knowledge clusters |
Operating Rule
Track loop dominance continuously:
health(t) = ρ·σ(K,t) - (δ + φ·K - I(t)/K)
If health(t) > 0, the system is in compounding mode.
If health(t) <= 0, growth has hit limits and controls must be tightened.
Part 6: The Convergence — CDLC as the Unifying Spine
Every thread in this document — DevOps, cognitive science, MemRL, the ratchet, the math — converges on one structure: the Context Development Life Cycle. The CDLC is the DevOps infinity loop rewritten for context instead of code. Each phase of the loop is where a different theoretical thread becomes operational.
The Convergence Map
| CDLC Phase | DevOps Three Ways | 12-Factor Principle | Gap Closed | Theoretical Thread | The Math |
|---|---|---|---|---|---|
| Generate | — | I: Context Is Everything, IV: Research Before You Build | — | Cognitive 40% load: generate the right context, not all context | Increases I(t) — knowledge inflow |
| Compile | Flow | I: Context Is Everything | — | Lost-in-middle (Liu 2023): compilation prevents context drowning. Meadows #6: information flows are higher leverage than rules | Maximizes σ — retrieval precision |
| Test | Feedback | V: Validate Externally, IX: Measure What Matters | Judgment Validation | Brownian Ratchet filter: chaos enters, only validated work passes. Error budgets (SRE): non-deterministic evals need tolerance, not pass/fail | Prevents bad I(t) from entering K |
| Distribute | — | II: Track Everything in Git, X: Isolate Workers | — | Software Factory: the environment carries continuity, workers are replaceable. Packaging makes context portable across runtimes | Reduces φ — scale friction drops when context is shared |
| Deliver | Flow | I: Context Is Everything | — | Escape velocity threshold: σ × ρ > δ. Delivery is where retrieval meets the session. Phase-scoped, role-scoped, freshness-weighted |
The moment σ acts on K |
| Observe | Feedback | IX: Measure What Matters, XII: Harvest Failures | Loop Closure | MemRL (Zhang 2025): citation events become training signal. SRE observability: you can't improve what you don't measure | Feeds ρ — usage signal that scores utility |
| Adapt | Continual Learning | VII: Extract Learnings, VIII: Compound Knowledge, VI: Lock Progress | Durable Learning | Flywheel escape velocity: σ × ρ > δ. Ratchet one-way gate: adapted knowledge can't regress. K8s control loops: declared state + reconcile |
The full inequality: reinforcing loops stay stronger than balancing loops |
Reading the Map
Vertically (by phase): Each row shows how one CDLC phase draws from multiple threads simultaneously. The Test phase, for example, is DevOps feedback, the 12-factor validation principle, the judgment gap, the ratchet filter mechanism, and the SRE error budget — all expressing the same idea at different levels of abstraction.
Horizontally (by thread): Each column shows how one theoretical thread expresses itself across multiple phases. The Brownian Ratchet appears in Test (the filter), Deliver (the gate that lets knowledge through), and Adapt (the one-way lock that prevents regression). Same mechanism, different phases.
The three gaps distribute across the loop:
- Judgment Validation lives in Test. Plans and code are validated before they propagate.
- Loop Closure lives in Observe. Completed work produces signals that feed back.
- Durable Learning lives in Adapt. Signals become permanent knowledge that compounds.
The gaps are not separate problems. They are the three places where the CDLC loop can break.
Why It Took Five Pillars
No single thread explains the system:
-
DevOps gives the process shape — the infinity loop, the three ways, the discipline lineage. But DevOps was built for humans. Agents are different: they don't remember, they don't learn between sessions, they have no institutional knowledge. DevOps alone can't account for that.
-
Cognitive science explains why context management matters — the 40% load rule, lost-in-middle, attention mechanics. But it describes constraints, not solutions. It says what goes wrong. It doesn't say how to build the system that prevents it.
-
MemRL provides the feedback mechanism — reinforcement learning on episodic memory, utility scoring, citation-driven reward signals. But MemRL is a learning algorithm. It doesn't provide the lifecycle structure that feeds it data.
-
The Brownian Ratchet explains how forward progress happens in a noisy system — chaos plus filter plus one-way gate equals net movement. But it's a physics metaphor. It doesn't tell you what the filter is or where the gate goes.
-
Systems dynamics (Meadows) identifies the leverage points — information flows, rules, self-organization, goals. But it's a framework for thinking about systems, not a blueprint for building one.
The CDLC is the blueprint. It takes each thread and assigns it a phase:
- DevOps gives the loop shape
- Cognitive science constrains Generate and Compile
- The ratchet operates in Test and Adapt
- MemRL drives Observe and Adapt
- Meadows tells you which phases are highest leverage (Adapt > Observe > Test > everything else)
None of the threads is the answer. The loop that connects them is.
Conclusion: The Goal Is The Math
Everything in AgentOps exists to achieve one thing:
Operational check:
σ × ρ > δ/100
Scale-aware form:
ρ·σ(K,t) > δ + φ·K - I(t)/K
When this is true, knowledge compounds. When it's false, growth stalls or reverses.
This is a control problem, not a slogan. Reinforcing loops must stay stronger than balancing loops over time.
Every feature, every skill, every CLI command serves this inequality:
| Feature | How It Helps |
|---|---|
/forge |
Increases I(t) — more knowledge in |
/inject |
Increases σ — better retrieval |
/vibe, /pre-mortem |
Filter bad work before it wastes cycles |
ao feedback |
Improves σ via utility learning |
| Tiering/pruning/re-indexing | Prevents limits-to-growth collapse in σ and φ |
| Ratchet chain | Prevents K from regressing |
| 40% rule | Keeps σ high by avoiding lost-in-middle |
The goal is the math, with explicit scale limits. The system is only "bulletproof" if we measure loop dominance and adapt controls as K grows.
References
Knowledge Decay
- Darr, E. D., Argote, L., & Epple, D. (1995). "The Acquisition, Transfer, and Depreciation of Knowledge in Service Organizations." Management Science, 41(11), 1750-1762.
- Ebbinghaus, H. (1885). Über das Gedächtnis. Leipzig: Duncker & Humblot.
Cognitive Science
- Miller, G. A. (1956). "The magical number seven, plus or minus two." Psychological Review, 63(2), 81-97.
- Cowan, N. (2001). "The magical number 4 in short-term memory." Behavioral and Brain Sciences, 24(1), 87-114.
- Sweller, J. (1988). "Cognitive load during problem solving." Cognitive Science, 12(2), 257-285.
- Paas, F., & van Merriënboer, J. J. (2020). "Cognitive-load theory." Current Directions in Psychological Science, 29(4), 394-398.
- Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. Harper & Row.
- Yerkes, R. M., & Dodson, J. D. (1908). "The relation of strength of stimulus to rapidity of habit-formation." Journal of Comparative Neurology and Psychology, 18(5), 459-482.
LLM Context
- Liu, N. F., et al. (2023). "Lost in the Middle: How Language Models Use Long Contexts." arXiv:2307.03172.
Memory-Augmented Learning
- Zhang, S., Wang, J., Zhou, R., Liao, J., Feng, Y., Zhang, W., Wen, Y., Li, Z., Xiong, F., Qi, Y., Tang, B., & Wen, M. (2025). "MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memory." arXiv:2601.03192. https://arxiv.org/abs/2601.03192
DevOps
- Kim, G., Humble, J., Debois, P., & Willis, J. (2016). The DevOps Handbook. IT Revolution Press.
Systems Dynamics
- Meadows, D. H. (2008). Thinking in Systems: A Primer. Chelsea Green Publishing.
- Meadows, D. H., Meadows, D. L., Randers, J., & Behrens, W. W. (1972). The Limits to Growth. Universe Books.
"The goal is the math. Everything else is implementation."