Commit Graph

547 Commits

Author SHA1 Message Date
Developers Digest 56e10912cf fix(cli): Alexandria wording in the command help and request error 2026-09-12 20:42:16 -04:00
Developers Digest adc87792cc fix(cli): the keyless refusal recognises the exchange alias, so unit tests no longer reach the API 2026-09-12 20:34:48 -04:00
Developers Digest d6156f320f feat(cli): domain tools is the only flag; drop the unshipped --skills alias 2026-09-12 19:47:43 -04:00
Developers Digest 8be3577e76 fix(cli): resolve terms for unlisted providers through Find Tools, deprecation note for --skills, compact domain tools output 2026-09-12 19:40:01 -04:00
Developers Digest c2005e0376 feat(cli): call Find Tools as provider firecrawl capability find-tools 2026-09-12 14:49:06 -04:00
Developers Digest d0284c16b8 docs(skill): name the domain-tools flag the CLI actually exposes 2026-09-12 14:43:46 -04:00
Developers Digest 73c6f51ef0 feat(cli): relay Alexandria provider terms and add interactive terms accept
Carry requiresAction through exchange retrieve and scrape failures, print a
terms block in human mode and a failure envelope in --json mode, add
`firecrawl alexandria terms <provider>` and `terms accept <provider>`
(interactive only, posts to the dashboard accept route), register the group as
`alexandria` with `exchange` as a hidden alias, and document the flow.
2026-09-12 14:41:15 -04:00
Developers Digest 10dbb20ab2 feat(cli): rename provider execution key to alexandria 2026-09-11 23:08:48 -04:00
Developers Digest 1ff57f232e feat(cli): align Alexandria search and scrape with domainTools and error codes 2026-09-11 22:30:06 -04:00
Developers Digest 08e5e13a47 docs(skills): teach Alexandria discovery and execution 2026-09-11 11:42:48 -04:00
Developers Digest ffd227ea80 feat: add Alexandria search and Find Tools workflow 2026-09-11 09:05:29 -04:00
Developers Digest 21cccc51cc Add Alexandria discovery and retry IDs to CLI 2026-09-10 16:47:19 -04:00
Developers Digest ec55fdb7db docs(exchange): use provider-relative capability addresses in examples
Exchange capability addresses are provider-relative (e.g. series/observations
for fred), not finance/series/observations. Fix README, help text, option
descriptions, comments and test fixtures; no behaviour change.

Claude-Session: https://claude.ai/code/session_01KpbshKPNuCDBD4TLJ8T2UQ
2026-09-02 14:36:34 -04:00
Developers Digest 5c20f3defd feat(exchange): add v2 Exchange support to search, scrape and a new exchange command
Search accepts `--sources exchange` and passes `data.exchange[]` capability
hits through untouched (readable "=== Exchange Providers ===" section, JSON
keeps id/creditsUsed). New `firecrawl exchange discover [cohort] [provider]
[capability] [--query q] [--limit n] [--expand all]` walks or semantically
searches the catalogue via GET /exchange/discover, and `firecrawl exchange
retrieve <provider/capability>... --options '<json>'` executes capabilities
through the url-less POST /v2/scrape {exchange:[...], integration:'cli'}
shape, printing each item with its creditsCost and mirroring the API
envelope with --json. `firecrawl scrape --exchange provider/capability
--options '<json>'` delegates to the same executor. Exchange requests are
refused locally in keyless mode with an explanatory error (exit 1) and API
error bodies (403/402/409) are relayed instead of the axios status text.

Claude-Session: https://claude.ai/code/session_01KpbshKPNuCDBD4TLJ8T2UQ
2026-09-02 11:05:33 -04:00
Nicolas 86aaf06cb1 Update package.json v1.23.3 2026-08-26 18:16:27 -07:00
Nicolas 509dd9c517 Nick: build skills references 2026-08-26 18:16:02 -07:00
Karan Lokchandani 1b7ac5fe2d release: 1.23.2 v1.23.2 2026-08-26 13:08:09 +05:30
Karan Lokchandani 6a0fac5006 fix(developer): deduplicate URLs and clean separators 2026-08-26 10:59:32 +05:30
Eric Ciarla 026c820beb release: 1.23.1
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
v1.23.1
2026-08-21 11:07:03 -04:00
Eric Ciarla 4867dc9358 Fix skill-scoped installs installing the whole catalog
skills add --all means "ALL skills to all agents" and silently overrides
any --skill filter, so every scoped install (setup core/build/workflows,
setup <skill>, and init's selections) was installing all 33 catalog
skills. Scoped installs now pass --yes instead of --all: same promptless
install to every detected agent, but the --skill list is respected.

Verified: setup developer-index installs 1 skill, setup build installs 5.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 11:06:25 -04:00
Eric Ciarla 3538f0d8a9 Fix CI: remove stray package-lock.json, reformat setup.ts with pinned prettier
package-lock.json was accidentally committed in #206 (an npm install
artifact — this repo is pnpm-managed). bun prefers it over pnpm-lock.yaml
in release-binaries, and its migration fails under --frozen-lockfile.
Remove it and gitignore it.

setup.ts was formatted by prettier 3.9.6 from that same npm node_modules;
CI pins 3.7.4 via pnpm-lock.yaml. Reformatted with 3.7.4.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
v1.23.0
2026-08-21 10:56:31 -04:00
Eric Ciarla 2c99ab6df2 release: 1.23.0
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:49 -04:00
Eric Ciarla c110d2e610 Offer auth after skill installs without blocking automation
After any setup skill install, check for an API key (env var or stored
credentials). Authenticated users see nothing. Otherwise: --browser runs
the browser login directly, an interactive terminal offers it (default
yes), and non-interactive runs print a one-line hint — never a prompt,
so agents, scripts, and CI are unaffected. The bundle flow defers the
offer until every step has run so it never asks twice.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:35 -04:00
Eric Ciarla d2f78c3f56 Accept a single catalog skill name as a setup subcommand
firecrawl setup developer-index   # firecrawl- prefix optional
firecrawl setup firecrawl-scrape

Group subcommands keep precedence, so `setup build` means the group and
`setup firecrawl-build` reaches the skill.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:35 -04:00
Eric Ciarla f6d5dcee88 Add setup core/build group subcommands
One short command per skill family:

  firecrawl setup core       # primitives + index skills ("skills" stays as alias)
  firecrawl setup build      # app-integration skills (previously not installable via setup)
  firecrawl setup workflows  # unchanged

The build family had no install path since init dropped it; BUILD_SKILLS
mirrors the five build skills in the catalog. All groups install from the
catalog by name, so skills.sh counters stay consolidated.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 10:31:35 -04:00
Eric Ciarla f0adf5300b Point catalog sync at skills/core/
The catalog directory is being renamed from skills/cli/ to skills/core/ —
the family covers the Firecrawl primitives via CLI or MCP, not just the
CLI. Install selection is name-based, so slugs are unaffected.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-21 08:51:11 -04:00
Chenxin Yan 285fb952c7 fix(setup): filter the no-npx native fallback to the selected skills
Review fixes for #203:
- setup's no-npx fallback called installSkillsNative(repo) without the
  name filter, installing the entire catalog (build skills included)
  instead of the selection every other install path uses
- drop the nonexistent --skills-only CLI flag from the developer-index
  skill (skills="only" stays HTTP/MCP-only per cli-argv contract)
- note that the workflow retry hint reinstalls all workflow skills, not
  the picked subset
- fix 'sturctural' typo in the research-index skill
2026-08-21 08:31:40 -04:00
Chenxin Yan a5725bbb77 docs: update routing rule for the pure-catalog architecture 2026-08-21 08:31:40 -04:00
Chenxin Yan 1603c24375 feat(skills): adopt the research/developer index skills as CLI skills
They teach the firecrawl research and firecrawl developer CLI commands,
so this repo is their code home. Authored here, mirrored to the catalog
under skills/cli/, and included in the default init/setup CLI set.
2026-08-21 08:31:40 -04:00
Chenxin Yan a4e7920aad fix(setup): align setup skills/workflows with init's catalog selections
The init retry hints point at setup skills/workflows, but those still
installed from the legacy repo list (including build skills init no
longer installs). Share the catalog selections between init and setup
so a retry reinstalls exactly what init attempted. Harden the sync
workflow: least-privilege token, SHA-pinned checkout.
2026-08-21 08:31:40 -04:00
Chenxin Yan 7967dba844 feat(init): install CLI skills by default, workflow multi-select, drop build skills
Route all init skill installs through the firecrawl/skills catalog with
name-based --skill selection so install volume accrues to catalog
counters. Interactive init now offers a multi-select of the 16 workflow
skills; build skills are no longer installed (they target SDK
integration, not CLI users, and remain one command away). Promote
npx skills add firecrawl/skills and the contributor routing rule in the
README.
2026-08-21 08:31:40 -04:00
Chenxin Yan 92cdba4f6c ci: sync CLI skills to the firecrawl/skills catalog
Mirror skills/ into catalog skills/cli/ on every push, with a mirror
banner README, no-op detection, and rebase-retry push via deploy key.
2026-08-21 08:31:40 -04:00
Karan Lokchandani 0f23abf9dd release: 1.22.0 (#202)
Developer search is a lean agent surface: query and --limit only. All
filter flags removed (breaking): --passages, --types, --repos, --sources,
--language, --topic, --license, --min-stars, --max-stars, --archived,
--fork, --skills-only. Scoping intent belongs in the query text.
v1.22.0
2026-08-21 05:17:14 +05:30
Karan Lokchandani c1ac99f863 drop skill file from this change 2026-08-21 05:09:31 +05:30
Karan Lokchandani 2bb551a12f guard passages access in readable output 2026-08-21 05:09:31 +05:30
Karan Lokchandani bb130e336a developer: lean agent surface (query + limit only)
Squashed clean over main: removes all filter flags (types, repos,
sources, language, topic, license, min/max stars, archived, fork,
skills, passages); keeps server-shaped passages, citations, license
rendering, kind-from-id-prefix, and index-status echoes. Resolves
review: results typed optional, id access guarded, empty status
sections render no heading. No REST-API pointers in help text.
2026-08-21 05:09:31 +05:30
Max a47850d0aa Add developer-index and research-index session skills (#201)
* Add developer-index and research-index as session skills.

They belong with the CLI, not the build skills repo. Developer hits use the live id prefix for kind; search-papers hits are paperId, primaryId, ids, title, abstract, and score.

* Align index session skills with the live wire and shorter trigger descriptions.

* Match developer and research index skills to the prod scrape/map shape.

Quick start, --help instead of option tables, and a Done when line, while keeping the live id-prefix and paperId response shapes.
2026-08-21 01:53:04 +05:30
Chenxin Yan bed74cb4ab fix(skills): address PR review — map/interact triggers, scrape done-when accuracy, valid JSON example 2026-08-20 14:48:16 -04:00
Chenxin Yan 1d5be95508 fix(skills): restore neutral-task adoption trigger, add rate-limit and auth terminal rules
EXP-046 forensics: claude SKOP-NEU-02 skipped Firecrawl in optimized arms
(lost web-research trigger); monitor traces looped on 429 to 600s timeouts;
bad-key traces retried identical failing calls.
2026-08-20 14:48:16 -04:00
Chenxin Yan 980163d726 refactor(skills): restructure bodies — help pointers, monitor split, positive phrasing, completion criteria
- Replace cached CLI option tables with 'firecrawl <cmd> --help' pointers,
  keeping only options the recipes actually use (all verified against src/)
- Delete 'When to use' sections that restated frontmatter descriptions
- Split firecrawl-monitor: lean recipe in SKILL.md, goal/query authoring in
  goals.md, JSON change tracking in json-tracking.md, each behind a one-line
  'read when' pointer
- Rewrite never/don't phrasing as positive instructions; keep genuine
  opt-out and data guardrails
- Add exactly one 'Done when' completion criterion per skill

skills/**/*.md drops from 1045 to 837 lines (SKILL.md files: 1045 -> 723).
2026-08-20 14:48:16 -04:00
Chenxin Yan 41cc07c7e1 refactor(skills): dedupe router, single-source monitor/install/search content
- Router SKILL.md 329 -> 141 lines: pure routing; monitor details,
  install/auth, and search-feedback specifics now live only in their
  sub-skills, with routing pointers left behind.
- Moved two unique monitor facts into firecrawl-monitor (markdown-only
  diff.json parse-diff AST note; goal bullet about user-named noise).
- Resolved keyless contradiction: keyless free tier is real for
  search/scrape/interact (src/utils/client.ts isKeylessMode; scrape and
  search absent from AUTH_REQUIRED_COMMANDS in src/index.ts). Single
  correct statement kept in rules/install.md, including which commands
  prompt interactive login.
2026-08-20 14:48:16 -04:00
Chenxin Yan 5b171dcef2 refactor(skills): compress router and monitor descriptions to one routing sentence 2026-08-20 14:48:16 -04:00
Chenxin Yan 3ebf535a8c refactor(skills): shrink descriptions to trigger-first form
Descriptions are always-loaded context; trigger-first wording cuts token load while keeping every distinct trigger branch.
2026-08-20 14:48:16 -04:00
Karan Lokchandani bd84b07855 release: 1.21.1 (#199)
Fixes the developer-search artifact-kind label: derived from the id
prefix (the wire carries no type field), so it renders again.
v1.21.1
2026-08-20 22:50:23 +05:30
Karan Lokchandani dac8a0b615 fix: derive the artifact kind from the id prefix
The developer-search wire carries no type field; the kind is encoded in
the id prefix (doc:, issue:, pull_request:, readme:). The old item.type
read matched nothing and the kind label silently never rendered.
2026-08-20 22:46:48 +05:30
Karan Lokchandani 8048d7c4d4 release: 1.21.0 (#197)
Developer search passages are now shaped server-side (search#843 policy):
the CLI trusts passage_budget_applied responses and keeps a legacy local
cut only for older servers. Removes the short-lived --passage-budget flag
before it ever shipped in a release.
v1.21.0
2026-08-20 15:54:36 +05:30
Karan Lokchandani ad3e539951 developer: keep passage budget server-side 2026-08-20 15:46:09 +05:30
Karan Lokchandani ff15c3f81b developer: validate passage budget flag 2026-08-20 15:46:09 +05:30
Karan Lokchandani e9b7be1784 developer: delegate passage sizing to search server 2026-08-20 15:46:09 +05:30
Chenxin Yan 253abdec0f docs(skills): restore agent-browser prefix in interact bash examples (#195)
interact sends --code literally to the API with no client-side
prefixing, and the server-side bash environment requires invoking
agent-browser explicitly (per maintainer review). The earlier fix
correctly removed the nonexistent --language flag but wrongly dropped
the prefix, over-generalizing from browser execute's auto-prefix
logic, which never runs for interact.
2026-08-19 02:38:16 +05:30