342 Commits

Author SHA1 Message Date
Developers Digest 42b990d06e Merge pull request #106 from firecrawl/docs/update-cli-version-refs
Update CLI version references
v1.16.2
2026-05-05 14:12:58 +00:00
Developers Digest 0aec57ad08 bump version to 1.16.2 2026-05-05 10:11:53 -04:00
Developers Digest 3cd5eadf9a update cli version references 2026-05-05 10:09:35 -04:00
Developers Digest c522f27ad4 Merge pull request #105 from firecrawl/update-gaps
Improvements
v1.16.1
2026-05-05 12:17:41 +00:00
Developers Digest 1c3c5ab02d bump version to 1.16.1 2026-05-04 12:06:22 -04:00
Developers Digest db445ae1f6 remove unsupported scrape webhook flag 2026-05-04 11:08:10 -04:00
Developers Digest f737873e9d Add webhook/cancel support and JSON parsing
Add support for webhook configuration and canceling jobs across agent, crawl, and scrape commands. Introduce JSON parsing helpers and CLI options for schema, actions, scrape-options, proxy, and webhook (inline or file), and validate payload shapes. Extend types to include webhook/cancel fields and normalize agent statuses to include "cancelled", updating polling and status handling accordingly. Propagate webhook/scrapeOptions through command handlers and improve CLI behavior for global --status handling and format resolution.
2026-05-04 10:56:23 -04:00
Gergő Móricz 3c6ac28a0c Merge pull request #103 from firecrawl/mog/parse-api
feat: parse command (ENG-4830)
v1.16.0
2026-04-27 17:24:38 +02:00
Abimael Martell d0145f4e62 feat: add --lockdown flag to scrape (#104)
* feat: add --lockdown-mode flag to scrape

* rename --lockdown-mode to --lockdown
2026-04-22 15:19:02 -07:00
Developers Digest aaca75fd1b bump version to 1.16.0 2026-04-22 11:09:17 -04:00
Developers Digest 1f8add95eb note 50 mb upload limit in parse skill 2026-04-22 09:47:17 -04:00
Developers Digest 1cbf76344d refine firecrawl-parse skill 2026-04-22 09:45:44 -04:00
Developers Digest 58df656735 drop --only-main-content from parse skill
option exists on api but isn't meaningful for pdf/docx/xlsx - no nav/footer/sidebar chrome to strip on local documents.
2026-04-22 09:38:02 -04:00
Developers Digest 33d6b3ba64 align parse skill with /v2/parse api ground truth
add .htm/.xhtml to supported list, add --timeout option. mirrors ParseFile/ParseOptions from firecrawl core (commit c7993d7).
2026-04-22 09:37:44 -04:00
Developers Digest 0101fc2e68 trim parse skill: less is more
cut to essentials. match density of firecrawl-map. dropped core-capability section, other-formats section, verbose tips.
2026-04-22 09:34:38 -04:00
Developers Digest 8985ddce01 bias parse skill toward save-to-file, drop weak formats
default pattern: parse to .firecrawl/ then grep/read. removed links/images/rawhtml from skill - kept markdown/html/summary (the formats that work cleanly on all supported file types).
2026-04-22 09:34:08 -04:00
Developers Digest 031020fa24 lead parse skill with markdown, demote format matrix
markdown is the 90% use case. moved formats table to secondary 'other formats' section. kept format availability caveat (links/images empty for pdfs).
2026-04-22 09:28:08 -04:00
Developers Digest 198b539648 add firecrawl-parse skill
covers local file parsing (pdf/docx/xlsx/etc) with summary and query shortcuts. registers in firecrawl-cli hub.
2026-04-22 09:21:01 -04:00
mogery 16e09f6339 feat: parse command 2026-04-21 18:15:39 +01:00
Developers Digest fefadc0e5b bump version to 1.15.2 v1.15.2 2026-04-16 12:17:44 -04:00
Developers Digest bc2c6d93a8 Switch agent scaffold to web-agent repo
Update vendored scaffold references and default remote to use firecrawl/web-agent. Adjusted header comments in create.ts, create-flow.ts, credentials.ts, manifest.ts, scaffold.ts, and ui.ts, and changed DEFAULT_REMOTE in manifest.ts from 'firecrawl/firecrawl-agent' to 'firecrawl/web-agent' so the scaffolder clones the web-agent repo for templates.
2026-04-16 12:16:44 -04:00
Developers Digest e55c2a2752 Merge pull request #98 from firecrawl/cli-implementation
bump version to 1.15.1
v1.15.1
2026-04-16 00:28:57 +00:00
Developers Digest 535c23283b bump version to 1.15.1 2026-04-15 20:27:10 -04:00
Developers Digest ffb0e9ef2b Merge pull request #97 from firecrawl/cli-implementation
Cli implementation
2026-04-15 17:59:04 +00:00
Developers Digest 47af8daf5c chore: friendlier error when default clone fails 2026-04-15 13:58:19 -04:00
Developers Digest b7c16d0df6 feat: vendor agent scaffolder into firecrawl-cli
Replaces the `npx firecrawl-agent-cli` delegator with an in-process
scaffolder vendored from firecrawl/firecrawl-agent. No separate npm
package for the agent CLI — the root firecrawl-cli clones the public
agent repo at runtime to fetch templates + agent-core.

- Vendor under src/utils/agent-scaffold/ (manifest, scaffold,
  credentials, ui, create-flow). Upstream-tracked; keep in sync.
- manifest.ts: strip the "bundled next to CLI" branch (doesn't apply
  here), always clone the public repo. Nested-manifest fallback
  handles the current `.internal/cli/agent-manifest.json` location.
- Extract handleCreate from upstream init.ts; drop the commander
  wrapper since the root CLI owns the command surface.
- create.ts now lazy-imports the scaffolder so non-create paths stay
  snappy.

Smoke-tested end-to-end against a local agent repo via --from: next
template scaffolds correctly with agent-core, .env.local, and
expected file layout.
2026-04-15 13:56:17 -04:00
Developers Digest 37fe1778b6 Merge pull request #96 from firecrawl/cli-implementation
feat:`firecrawl create agent` command
v1.15.0
2026-04-15 17:31:38 +00:00
Developers Digest fa0b300209 bump version to 1.15.0 2026-04-15 13:31:03 -04:00
Developers Digest 39bd5b7e48 feat: hidden firecrawl create agent command
Wires a hidden `firecrawl create <kind>` command tree into the root CLI.
Only the `agent` kind is registered today; it delegates to
`npx -y firecrawl-agent-cli create` with full flag passthrough so the
agent repo remains the single source of truth for templates.

The command is hidden from --help until `firecrawl-agent-cli` is on
npm. Flip to visible by removing `{ hidden: true }` in index.ts.

Surface:
  firecrawl create agent [name] [-t next|express|library]
  firecrawl create agent [name] --provider <p> --model <m>
  firecrawl create agent [name] --api-key <fc-key> --key anthropic=sk-...
  firecrawl create agent [name] --from user/repo
2026-04-15 13:23:23 -04:00
Eric Ciarla 959e570d9c Minor copy updates 2026-04-14 20:28:25 -04:00
Nicolas 3193905aa4 Nick: fixes when using -k v1.14.9 2026-04-13 17:58:57 -03:00
Eric Ciarla cd2c3e1e01 Updates 2026-04-11 13:51:47 -04:00
Developers Digest 42da89089f Merge pull request #93 from firecrawl/firecrawl-build-skills
swap interact example to action-oriented search + filter flow
v1.14.8
2026-04-10 16:04:54 +00:00
Developers Digest 1b48a69d99 swap interact example to action-oriented search + filter flow 2026-04-10 11:58:53 -04:00
Developers Digest 6f38b177af Merge pull request #92 from firecrawl/firecrawl-build-skills
split next-steps into web vs build sections + friendly install labels
v1.14.7
2026-04-10 15:53:08 +00:00
Developers Digest 9d6cc65c4c split next-steps into web vs build sections + friendly install labels
During install, show "Installing core firecrawl skills..." and
"Installing skills to build with firecrawl..." instead of the raw repo
names firecrawl/cli and firecrawl/skills. SKILL_REPO_LABELS map drives
the friendly text.

In the next-steps summary, split into two distinct groupings:
  1. "Connect & interact with the web (direct or in your AI agent)"
     with scrape/search/interact examples showing the natural language
     prompt next to the equivalent CLI command.
  2. "Building with firecrawl?" at the bottom, pointing at the build
     skills with a concrete business example.

MCP + --help entries sit between the two sections as general utilities.
Bumped to 1.14.7.
2026-04-10 11:52:13 -04:00
Developers Digest 2fb72edc51 Merge pull request #91 from firecrawl/firecrawl-build-skills
Firecrawl build skills
v1.14.6
2026-04-10 15:37:25 +00:00
Developers Digest 6da95bba24 use firecrawl-specific business example in next-steps tip 2026-04-10 11:04:36 -04:00
Developers Digest f91f069382 rephrase build-skills tip with concrete example, drop em dash 2026-04-10 11:01:50 -04:00
Developers Digest 6ef1aa565c add 'start building' tip to next-steps summary 2026-04-10 11:00:19 -04:00
Developers Digest 58a79fc7a8 Merge pull request #90 from firecrawl/firecrawl-build-skills
sync workflows: merge PRs immediately instead of using --auto
2026-04-10 14:36:59 +00:00
Developers Digest df6a4712a1 sync workflows: merge PRs immediately instead of using --auto
gh pr merge --auto requires branch protection with required status
checks on the target branch. firecrawl-claude-plugin and
firecrawl-cursor-plugin don't have that configured, so the workflows
fail with "Protected branch rules not configured for this branch
(enablePullRequestAutoMerge)" after successfully creating the PR.

There's nothing to wait for on a sync PR anyway, so drop --auto and
merge immediately.
2026-04-10 10:35:41 -04:00
Developers Digest 4ce31546af Merge pull request #89 from firecrawl/firecrawl-build-skills
Firecrawl build skills
v1.14.3
2026-04-10 14:27:47 +00:00
Developers Digest a7aa071f7a tighten next-steps summary and surface skill count
Parse '(Found|Installed) N skills' from captured npx skills output and
sum across both repos so the post-install summary shows
"✓ Installed 14 skills across your AI coding agents" instead of vague
text.

Collapse the next-steps block from 18 lines to 7: drop the 4 example
prompts in favor of one of each (AI prompt + direct CLI), plus the
MCP install hint and the --help pointer. Each entry uses padded labels
("Ask your AI:", "Run direct: ", "Add MCP:    ", "All commands:") so
the commands align in a column.

stepIntegrations and runNonInteractive both thread the count through
to printNextSteps. Tests still mock execSync as undefined, so
parseSkillCount handles the empty case. Bumped to 1.14.3.
2026-04-10 10:25:14 -04:00
Developers Digest c2e4856ef5 add mcp install hint to next-steps summary 2026-04-10 10:21:21 -04:00
Developers Digest fa735ff336 quiet skill install output and add next-steps summary
Replace the noisy 'npx skills add' inherited stdout (banner, +/symlink
table, security report, ~80 lines per repo) with a single line per repo:
"  ✓ firecrawl/cli" / "  ✓ firecrawl/skills". TTY runs get a transient
"↓ <repo>" indicator while the install is in flight; non-TTY runs (CI,
piped) get only the final line.

Replace the trailing "Setup complete!" line with a printNextSteps()
block that surfaces:
  - what just happened (skills installed globally)
  - what firecrawl is for (search, scrape, crawl, interact)
  - 4 example prompts (2 build-skill triggers, 2 direct CLI calls)
  - pointer to firecrawl --help

Both interactive and non-interactive init paths use the same helpers,
so output is consistent regardless of how users enter the flow.
Bumped to 1.14.2.
2026-04-10 10:17:42 -04:00
Developers Digest 6b98da37e9 Merge pull request #88 from firecrawl/firecrawl-build-skills
strip inherited npm_* env vars before nested npx calls
v1.14.1
2026-04-10 14:02:18 +00:00
Developers Digest f5d8c635c9 strip inherited npm_* env vars before nested npx calls
when this cli is launched via 'npx -y firecrawl-cli@VERSION', npm injects
npm_command/npm_lifecycle_event/npm_execpath/INIT_CWD into the process
env. those vars leak into nested execSync('npx -y skills add ...') calls
and cause the loop's second iteration to silently exit after the first
install completes — published 1.14.0 only installs from firecrawl/cli
even though SKILL_REPOS contains both repos.

cleanNpmEnv() in skills-install.ts strips those vars; init.ts and
setup.ts pass it as the env to every nested execSync. added a
regression test that primes process.env with the leaking vars and
asserts every install call sees a clean env. bumped to 1.14.1.
2026-04-10 09:58:30 -04:00
Developers Digest 39e7fbda2f Merge pull request #87 from firecrawl/firecrawl-build-skills
Firecrawl build skills
v1.14.0
2026-04-10 13:38:42 +00:00
Developers Digest df7fadc89c bump version to 1.14.0 2026-04-10 09:37:40 -04:00