Reframe the project around the skill rather than the CDC case: add static Overview, Guide, Prompt Lab, References, and 404 pages; a copyable rubric-complete brief template; prompt/harness boundaries; gotchas and workflow; 33 caveated research/vendor references; eight generated prompt downloads; shared navigation and copy controls; accessible tab semantics; responsive editorial styling; and updated release screenshots. The CDC run is now explicitly one unreviewed case study, not the site's foundation.
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
Lab README covers the four use cases, the reproduce steps (fetch -> verify ->
install -> build -> capture), how to read the scorecard, and an explicit
honesty/limits section (skill's own rubric, per-pair residual risk, unreviewed
CDC proof). Add the example to the root README examples table.
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
Normalize every SKILL.md description to double-quoted YAML so the corpus,
templates, and examples have one visible convention. Harden frontmatter
parsing against partial fence matches and non-string name/description values,
and extend tests to cover those regressions.
Fix stale or misleading developer-facing docs: remove phantom book-sft plugin
install instructions, document directory-copy installs, add .agents/skills
manual install guidance, fix the digital-brain setup script target, and mark
historical 13-skill analysis as historical. Cut the prepared release metadata
to 2.3.1 across manifests and root SKILL.md.
Tighten production gates by sharing dev dependencies, making orchestrators use
strict repo validation, aligning skill-health required sections with repo
validation, and linting documented plugin install commands against the actual
marketplace manifest.
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
* fix: YAML-safe skill frontmatter for cross-platform discovery
Eleven skills used unquoted descriptions containing colons, which strict
YAML parsers reject during skill discovery on Cursor, Claude Code, and
Codex. Normalize all skill frontmatter to valid YAML, add a shared
skill_frontmatter parser with PyYAML validation, fix install docs to use
directory layout, and add .agents/skills symlink plus Open Plugins
skills path declaration.
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
* test: add frontmatter parser unit tests and harden examples
Add researcher/scripts/tests/test_skill_frontmatter.py (19 tests) covering
parser edge cases, a strict-YAML regression guard for the unquoted-colon
bug, format/parse round-trips, and corpus + example integration checks.
Wire unit tests into CI ahead of the strict repo gate. Quote the
description fields in the two example skills that had the same
unquoted-colon YAML hazard. Simplify CRLF handling in split_frontmatter
and document CONTRIBUTING test commands.
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
* chore: harden production plugin packaging validation
Remove the committed .agents/skills symlink because symlinks are fragile
on Windows checkouts and in plugin packaging. Keep Cursor and Codex
support through Open Plugins discovery and documented directory-copy
manual installs.
Extend validate_repo.py so strict validation checks that the Open
Plugins manifest and Claude marketplace manifest name the same bundled
plugin, and that Open Plugins skills discovery resolves to the same 15
published skills as the repository.
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
* ci: certify cross-platform skill compatibility
Add validate_platform_compat.py to check the production surfaces defined by
Agent Skills, Cursor, Claude Code, Codex, and Open Plugins documentation.
The gate validates published skills, manifest discovery parity, and
platform-local directory-copy installs for .cursor/skills, .claude/skills,
.codex/skills, and .agents/skills.
Install skills-ref in CI and require the upstream agentskills reference
validator in the compatibility gate. Tighten manifest path checks so both
Claude marketplace and Open Plugins skill paths must start with './', and
update operator docs to run the new gate before claiming production
readiness.
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Muratcan Koylan <muratcankoylan@users.noreply.github.com>
Apply the auto-research quality standard across every published skill and update the mechanisms, claims, fixtures, benchmarks, and release docs so the corpus improves as a coherent system rather than isolated prose edits.
Co-authored-by: Cursor <cursoragent@cursor.com>
Promotes the release from v2.2.0 (scaffolding only) to v2.3.0 (measured
end-to-end results across four frontier models with delta-vs-baseline
attribution). Version bumped in marketplace.json, plugin.json, and root
SKILL.md.
Updates:
- CHANGELOG.md: new v2.3.0 entry with full per-model and per-skill effect
sizes, methodology notes, and honest scope caveats. v2.2.0 section
preserved as the scaffold release.
- researcher/benchmarks/PLAN.md: status table reflects Stage 0/1/2
shipped; Stage 3/4 still scaffolded. New "Shipped Stage 2 results"
subsection links to baseline and post-fix published reports.
- researcher/insights/auto-research-experiment.md: two new findings.
#14 documents the description-benchmark loop closing in ~2 hours with
+23.4pp on context-fundamentals. #15 documents concurrency + resume +
per-run logging as non-negotiable runner features. Reusable-patterns
list grows from 10 to 12.
- researcher/insights/how-we-built-this.md: new "Stage 2: The Description
-Benchmark Loop Closes" chapter. By-the-numbers updated: 14 activation
cases, 50 router prompts, 1200 measured agent calls across two sweeps,
4 models evaluated.
- README.md: researcher OS section gains a measured-results subsection
with per-skill effect-size table and per-model leaderboard.
- AGENTS.md: workspace memory captures the description-benchmark loop as
a learned default, the three runner non-negotiables (concurrency,
resume, per-run logging), and the API-key exposure rotation policy.
All gates green: validate_repo --strict 0 errors, run_benchmarks 0
failures, check_activation_cases 14 cases 0 failures, lints clean.
Co-authored-by: Cursor <cursoragent@cursor.com>
Ships a file-based research-to-skill operating system on top of the v2.1
skill corpus. The corpus now compounds across runs: mechanisms have a
gated promotion path, claims have explicit provenance, runs have an
enforceable state machine, skill activation is regression-tested, and the
harness is benchmarked against adversarial scenarios. A continuous loop
runs the whole thing unattended from launchd, retrieving sources over
stdlib HTTP and parking anything that needs human review.
Highlights
- Mechanism registry + accepted/rejected ledgers (5 seeded mechanisms)
- Claim provenance for 6 volatile claims across 6 skills
- Corpus index mapping skills to scenarios, mechanisms, and claims
- Activation regression fixtures (8 cases, all passing)
- Adversarial benchmark harness (7 scenarios) with append-only history
- Run state machine: initialized -> retrieved -> evaluated -> proposed ->
novelty_checked -> validated -> pr_ready -> closed
- Continuous loop (loop_discover, loop_step, loop_daily, loop_status)
with atomic JSONL writes and fcntl locks
- launchd service definitions and operator runbook
- CI workflow runs validate_repo --strict, run_benchmarks, and
check_activation_cases on every PR
- AGENTS.md, CHANGELOG.md, researcher/runs/README.md,
researcher/insights/auto-research-experiment.md
Skill changes
- All 14 published skills migrated from keyword triggers to
activation-scenario descriptions
- Hardened evaluation/advanced-evaluation and project-development/
harness-engineering boundaries
Repository policy
- Active research runs (researcher/runs/*/) are runtime state and
gitignored. Seed run kept as a worked example, closed reference-only.
- Runtime queue, logs, snapshots, status, and loop event files are
gitignored.
Verification
- validate_repo --strict: 0 errors, 0 warnings, 14 skills
- run_benchmarks: 3 checks, 0 failures, 7 scenarios
- check_activation_cases: 8 cases, 0 failures
- Python compile: clean (12 researcher scripts)
- Lint: clean
- Live loop: 13 iterations executed across init/retrieve/park/reap paths
No paid LLM judges, no automated source discovery beyond the manual seed,
and no log rotation. See researcher/insights/auto-research-experiment.md
for the full lessons-learned writeup.
Co-authored-by: Cursor <cursoragent@cursor.com>
Introduce a new skill for task-guided KV cache compaction between orchestrators and workers, and wire it into the collection so the pattern is discoverable and documented consistently.
Made-with: Cursor
The 5 bundled plugins all used source:"./", causing Claude Code to cache
5 identical copies of the entire repo (~12 MB redundant). This also caused
duplicate skills in /context. Consolidating to one plugin with all 13 skills
eliminates both issues.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Add new skill covering patterns for building hosted/background coding agents
based on Ramp's production implementation. Key topics include:
- Sandbox infrastructure with pre-built images and warm pools
- Modal integration for near-instant session starts
- Self-spawning agents for parallel task execution
- Multiplayer support for collaborative sessions
- Multi-client interfaces (Slack, Web, Chrome extension)
- Cloudflare Durable Objects for per-session state
Includes SKILL.md, detailed reference documentation, and Python example code.
New skill covering filesystem-based context engineering patterns:
- Scratch pad pattern for tool output offloading
- Plan persistence for long-horizon tasks
- Sub-agent file-based communication
- Dynamic skill loading
- Terminal/log persistence
- Self-modification patterns
Includes SKILL.md, implementation patterns reference, and demo script.
Added to agent-architecture plugin in marketplace.
- Remove individual .claude-plugin/plugin.json from each skill directory
- Update marketplace.json to use skills array (bundle format)
- Update README with correct plugin installation commands
Expands marketplace.json to list all skills explicitly and adds plugin.json manifests to each skill directory to enable proper discovery in Claude Code.
Expands marketplace.json to list all skills explicitly and adds plugin.json manifests to each skill directory to enable proper discovery in Claude Code.
muratcankoylan