539 Commits

Author SHA1 Message Date
Developers Digest b13186a125 Merge pull request #224 from firecrawl/alexandria/cli-beta
feat(cli): default Alexandria beta search to web and tools
2026-09-13 20:08:21 -04:00
Developers Digest 13adaa5197 feat(cli): default Alexandria beta search to web and tools 2026-09-13 20:07:44 -04:00
Developers Digest 51d28080a4 Merge pull request #223 from firecrawl/alexandria/cli-beta
feat(cli): alexandria beta
2026-09-13 19:46:33 -04:00
Developers Digest 7cbc02e7da feat(cli): bundle opt-in Alexandria beta skill 2026-09-13 19:12:08 -04:00
Developers Digest ffef1b136b feat(cli): gate Alexandria behind an opt-in prerelease 2026-09-13 19:07:24 -04:00
Max 06e2fd59d3 docs: correct skill installation and monitoring cost (#215) 2026-09-02 18:26:46 -05:00
Nicolas 86aaf06cb1 Update package.json v1.23.3 2026-08-26 18:16:27 -07:00
Nicolas 509dd9c517 Nick: build skills references 2026-08-26 18:16:02 -07:00
Karan Lokchandani 1b7ac5fe2d release: 1.23.2 v1.23.2 2026-08-26 13:08:09 +05:30
Karan Lokchandani 6a0fac5006 fix(developer): deduplicate URLs and clean separators 2026-08-26 10:59:32 +05:30
Eric Ciarla 026c820beb release: 1.23.1
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
v1.23.1
2026-08-21 11:07:03 -04:00
Eric Ciarla 4867dc9358 Fix skill-scoped installs installing the whole catalog
skills add --all means "ALL skills to all agents" and silently overrides
any --skill filter, so every scoped install (setup core/build/workflows,
setup <skill>, and init's selections) was installing all 33 catalog
skills. Scoped installs now pass --yes instead of --all: same promptless
install to every detected agent, but the --skill list is respected.

Verified: setup developer-index installs 1 skill, setup build installs 5.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 11:06:25 -04:00
Eric Ciarla 3538f0d8a9 Fix CI: remove stray package-lock.json, reformat setup.ts with pinned prettier
package-lock.json was accidentally committed in #206 (an npm install
artifact — this repo is pnpm-managed). bun prefers it over pnpm-lock.yaml
in release-binaries, and its migration fails under --frozen-lockfile.
Remove it and gitignore it.

setup.ts was formatted by prettier 3.9.6 from that same npm node_modules;
CI pins 3.7.4 via pnpm-lock.yaml. Reformatted with 3.7.4.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
v1.23.0
2026-08-21 10:56:31 -04:00
Eric Ciarla 2c99ab6df2 release: 1.23.0
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:49 -04:00
Eric Ciarla c110d2e610 Offer auth after skill installs without blocking automation
After any setup skill install, check for an API key (env var or stored
credentials). Authenticated users see nothing. Otherwise: --browser runs
the browser login directly, an interactive terminal offers it (default
yes), and non-interactive runs print a one-line hint — never a prompt,
so agents, scripts, and CI are unaffected. The bundle flow defers the
offer until every step has run so it never asks twice.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:35 -04:00
Eric Ciarla d2f78c3f56 Accept a single catalog skill name as a setup subcommand
firecrawl setup developer-index   # firecrawl- prefix optional
firecrawl setup firecrawl-scrape

Group subcommands keep precedence, so `setup build` means the group and
`setup firecrawl-build` reaches the skill.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:35 -04:00
Eric Ciarla f6d5dcee88 Add setup core/build group subcommands
One short command per skill family:

  firecrawl setup core       # primitives + index skills ("skills" stays as alias)
  firecrawl setup build      # app-integration skills (previously not installable via setup)
  firecrawl setup workflows  # unchanged

The build family had no install path since init dropped it; BUILD_SKILLS
mirrors the five build skills in the catalog. All groups install from the
catalog by name, so skills.sh counters stay consolidated.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:35 -04:00
Eric Ciarla f0adf5300b Point catalog sync at skills/core/
The catalog directory is being renamed from skills/cli/ to skills/core/ —
the family covers the Firecrawl primitives via CLI or MCP, not just the
CLI. Install selection is name-based, so slugs are unaffected.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 08:51:11 -04:00
Chenxin Yan 285fb952c7 fix(setup): filter the no-npx native fallback to the selected skills
Review fixes for #203:
- setup's no-npx fallback called installSkillsNative(repo) without the
  name filter, installing the entire catalog (build skills included)
  instead of the selection every other install path uses
- drop the nonexistent --skills-only CLI flag from the developer-index
  skill (skills="only" stays HTTP/MCP-only per cli-argv contract)
- note that the workflow retry hint reinstalls all workflow skills, not
  the picked subset
- fix 'sturctural' typo in the research-index skill
2026-08-21 08:31:40 -04:00
Chenxin Yan a5725bbb77 docs: update routing rule for the pure-catalog architecture 2026-08-21 08:31:40 -04:00
Chenxin Yan 1603c24375 feat(skills): adopt the research/developer index skills as CLI skills
They teach the firecrawl research and firecrawl developer CLI commands,
so this repo is their code home. Authored here, mirrored to the catalog
under skills/cli/, and included in the default init/setup CLI set.
2026-08-21 08:31:40 -04:00
Chenxin Yan a4e7920aad fix(setup): align setup skills/workflows with init's catalog selections
The init retry hints point at setup skills/workflows, but those still
installed from the legacy repo list (including build skills init no
longer installs). Share the catalog selections between init and setup
so a retry reinstalls exactly what init attempted. Harden the sync
workflow: least-privilege token, SHA-pinned checkout.
2026-08-21 08:31:40 -04:00
Chenxin Yan 7967dba844 feat(init): install CLI skills by default, workflow multi-select, drop build skills
Route all init skill installs through the firecrawl/skills catalog with
name-based --skill selection so install volume accrues to catalog
counters. Interactive init now offers a multi-select of the 16 workflow
skills; build skills are no longer installed (they target SDK
integration, not CLI users, and remain one command away). Promote
npx skills add firecrawl/skills and the contributor routing rule in the
README.
2026-08-21 08:31:40 -04:00
Chenxin Yan 92cdba4f6c ci: sync CLI skills to the firecrawl/skills catalog
Mirror skills/ into catalog skills/cli/ on every push, with a mirror
banner README, no-op detection, and rebase-retry push via deploy key.
2026-08-21 08:31:40 -04:00
Karan Lokchandani 0f23abf9dd release: 1.22.0 (#202)
Developer search is a lean agent surface: query and --limit only. All
filter flags removed (breaking): --passages, --types, --repos, --sources,
--language, --topic, --license, --min-stars, --max-stars, --archived,
--fork, --skills-only. Scoping intent belongs in the query text.
v1.22.0
2026-08-21 05:17:14 +05:30
Karan Lokchandani c1ac99f863 drop skill file from this change 2026-08-21 05:09:31 +05:30
Karan Lokchandani 2bb551a12f guard passages access in readable output 2026-08-21 05:09:31 +05:30
Karan Lokchandani bb130e336a developer: lean agent surface (query + limit only)
Squashed clean over main: removes all filter flags (types, repos,
sources, language, topic, license, min/max stars, archived, fork,
skills, passages); keeps server-shaped passages, citations, license
rendering, kind-from-id-prefix, and index-status echoes. Resolves
review: results typed optional, id access guarded, empty status
sections render no heading. No REST-API pointers in help text.
2026-08-21 05:09:31 +05:30
Max a47850d0aa Add developer-index and research-index session skills (#201)
* Add developer-index and research-index as session skills.

They belong with the CLI, not the build skills repo. Developer hits use the live id prefix for kind; search-papers hits are paperId, primaryId, ids, title, abstract, and score.

* Align index session skills with the live wire and shorter trigger descriptions.

* Match developer and research index skills to the prod scrape/map shape.

Quick start, --help instead of option tables, and a Done when line, while keeping the live id-prefix and paperId response shapes.
2026-08-21 01:53:04 +05:30
Chenxin Yan bed74cb4ab fix(skills): address PR review — map/interact triggers, scrape done-when accuracy, valid JSON example 2026-08-20 14:48:16 -04:00
Chenxin Yan 1d5be95508 fix(skills): restore neutral-task adoption trigger, add rate-limit and auth terminal rules
EXP-046 forensics: claude SKOP-NEU-02 skipped Firecrawl in optimized arms
(lost web-research trigger); monitor traces looped on 429 to 600s timeouts;
bad-key traces retried identical failing calls.
2026-08-20 14:48:16 -04:00
Chenxin Yan 980163d726 refactor(skills): restructure bodies — help pointers, monitor split, positive phrasing, completion criteria
- Replace cached CLI option tables with 'firecrawl <cmd> --help' pointers,
  keeping only options the recipes actually use (all verified against src/)
- Delete 'When to use' sections that restated frontmatter descriptions
- Split firecrawl-monitor: lean recipe in SKILL.md, goal/query authoring in
  goals.md, JSON change tracking in json-tracking.md, each behind a one-line
  'read when' pointer
- Rewrite never/don't phrasing as positive instructions; keep genuine
  opt-out and data guardrails
- Add exactly one 'Done when' completion criterion per skill

skills/**/*.md drops from 1045 to 837 lines (SKILL.md files: 1045 -> 723).
2026-08-20 14:48:16 -04:00
Chenxin Yan 41cc07c7e1 refactor(skills): dedupe router, single-source monitor/install/search content
- Router SKILL.md 329 -> 141 lines: pure routing; monitor details,
  install/auth, and search-feedback specifics now live only in their
  sub-skills, with routing pointers left behind.
- Moved two unique monitor facts into firecrawl-monitor (markdown-only
  diff.json parse-diff AST note; goal bullet about user-named noise).
- Resolved keyless contradiction: keyless free tier is real for
  search/scrape/interact (src/utils/client.ts isKeylessMode; scrape and
  search absent from AUTH_REQUIRED_COMMANDS in src/index.ts). Single
  correct statement kept in rules/install.md, including which commands
  prompt interactive login.
2026-08-20 14:48:16 -04:00
Chenxin Yan 5b171dcef2 refactor(skills): compress router and monitor descriptions to one routing sentence 2026-08-20 14:48:16 -04:00
Chenxin Yan 3ebf535a8c refactor(skills): shrink descriptions to trigger-first form
Descriptions are always-loaded context; trigger-first wording cuts token load while keeping every distinct trigger branch.
2026-08-20 14:48:16 -04:00
Karan Lokchandani bd84b07855 release: 1.21.1 (#199)
Fixes the developer-search artifact-kind label: derived from the id
prefix (the wire carries no type field), so it renders again.
v1.21.1
2026-08-20 22:50:23 +05:30
Karan Lokchandani dac8a0b615 fix: derive the artifact kind from the id prefix
The developer-search wire carries no type field; the kind is encoded in
the id prefix (doc:, issue:, pull_request:, readme:). The old item.type
read matched nothing and the kind label silently never rendered.
2026-08-20 22:46:48 +05:30
Karan Lokchandani 8048d7c4d4 release: 1.21.0 (#197)
Developer search passages are now shaped server-side (search#843 policy):
the CLI trusts passage_budget_applied responses and keeps a legacy local
cut only for older servers. Removes the short-lived --passage-budget flag
before it ever shipped in a release.
v1.21.0
2026-08-20 15:54:36 +05:30
Karan Lokchandani ad3e539951 developer: keep passage budget server-side 2026-08-20 15:46:09 +05:30
Karan Lokchandani ff15c3f81b developer: validate passage budget flag 2026-08-20 15:46:09 +05:30
Karan Lokchandani e9b7be1784 developer: delegate passage sizing to search server 2026-08-20 15:46:09 +05:30
Chenxin Yan 253abdec0f docs(skills): restore agent-browser prefix in interact bash examples (#195)
interact sends --code literally to the API with no client-side
prefixing, and the server-side bash environment requires invoking
agent-browser explicitly (per maintainer review). The earlier fix
correctly removed the nonexistent --language flag but wrongly dropped
the prefix, over-generalizing from browser execute's auto-prefix
logic, which never runs for interact.
2026-08-19 02:38:16 +05:30
Max 0c546357df Merge pull request #193 from chenxin-yan/skills/consolidated-docs-fixes
docs(skills): fix command guidance, auth requirements, and workflow drift
2026-08-18 12:43:45 -07:00
Chenxin Yan bb03b0a446 docs(skills): make the feedback example valid for every rating
The collapsed example only sent --missing-content, so substituting
--rating good violated the valuable-sources requirement and the
--silent call swallowed the HTTP 400, silently losing the refund.
Show both --valuable-sources and --missing-content so any rating
substitution satisfies the substantive-content rule.
2026-08-18 15:37:25 -04:00
Chenxin Yan d3d3ff0cc3 docs(skills): use a rating placeholder so feedback examples stay unbiased
A live --rating good default anchors copy-paste agents toward
reporting good and skews the feedback signal. Show a
<good|partial|bad> placeholder that cannot run until the agent
chooses, keep the rating-neutral --missing-content field as the
worked example, and let the rules list govern per-rating required
fields. Applied to both mirrored snippets.
2026-08-18 15:30:10 -04:00
Chenxin Yan c111a31d4b docs(skills): collapse feedback example to one default call
Replace the three parallel rating examples (latterly commented
alternates) with a single guarded good-rating call. The rules list
above already defines per-rating field requirements and the
--missing-content section documents payload shapes, so the extra
examples duplicated both. Follows the default-with-escape-hatch
pattern and matches the mirrored firecrawl skill snippet.
2026-08-18 15:27:54 -04:00
Chenxin Yan adb47cc31d docs(skills): make only one feedback rating live in the guard example
All three rating calls were live sequential commands inside the guard,
so a literal copy-paste submitted three conflicting ratings for one
search id. Keep the good-rating call live and show partial/bad as
commented alternates, matching the "send exactly one" prose.
2026-08-18 15:22:52 -04:00
Chenxin Yan 561776fe23 docs(skills): update stale firecrawl-cli link labels to firecrawl 2026-08-18 15:16:06 -04:00
Chenxin Yan dbfe84c4cc docs(skills): finish firecrawl skill rename and inline the feedback guard
Update the .claude-plugin skill paths missed by the folder rename, and
move the three search-feedback examples inside the guard conditional so
copying any of them cannot bypass the zero-result check.
2026-08-18 15:12:35 -04:00
Chenxin Yan 5f94d6fb6f docs(skills): rename firecrawl-cli skill folder to match its frontmatter name
The installer copies each skill to ~/.agents/skills/<frontmatter-name>/,
and the router skill is named "firecrawl", so ../firecrawl-cli/SKILL.md
links 404ed after install. Rename the folder to skills/firecrawl/ so the
folder and frontmatter agree and cross-skill links resolve both in-repo
and installed.
2026-08-18 14:27:08 -04:00