Commit Graph

362 Commits

Author SHA1 Message Date
Developers Digest dbfb3b3b55 Update session-tracking.ts 2026-05-22 13:55:32 -04:00
Developers Digest b0f9ea6f7a send session_id header on api requests 2026-05-22 12:51:13 -04:00
Nicolas 846f111e66 Merge pull request #109 from firecrawl/monitoring
feat(monitoring): implement monitoring
v1.18.0
2026-05-17 12:54:34 -04:00
Nicolas c3e8c8a931 Nick: 2026-05-17 12:51:44 -04:00
Nicolas dac0d071c1 Update package.json 2026-05-17 12:50:26 -04:00
Nicolas f873e5bfd2 Merge branch 'main' into monitoring 2026-05-17 12:48:54 -04:00
Nicolas f912108a64 Update SKILL.md 2026-05-17 12:48:42 -04:00
Eric Ciarla 32309be1c8 Add workflows to cli! v1.17.1 2026-05-15 09:44:34 -04:00
Nicolas f448fc25b6 Merge pull request #110 from firecrawl/nsc/search-feedback
(feat/search) Search feedback
v1.17.0
2026-05-14 15:42:06 -04:00
Nicolas 4e0337677d Merge branch 'main' into nsc/search-feedback 2026-05-14 14:50:31 -04:00
Nicolas 9fad8ca542 Update package.json 2026-05-14 14:34:08 -04:00
Nicolas 60925e5e9f Nick: search feedback 2026-05-14 14:33:29 -04:00
Developers Digest e251e6f012 bump @mendable/firecrawl-js to 4.22.2; document why monitor still uses raw fetch 2026-05-12 11:22:33 -04:00
Developers Digest 84140d9af1 monitor: rename --urls to --scrape-urls to pair with --crawl-url 2026-05-12 11:13:18 -04:00
Developers Digest 19ae52cc73 monitor: accept JSON via positional file or piped stdin; document in skill 2026-05-12 11:06:00 -04:00
Developers Digest 933930b1fe monitor: accept JSON file/stdin and remove --body
Allow monitor create/update commands to consume a JSON payload from a positional file argument or piped stdin (use '-' to force stdin). Introduce async readJsonPayload helper, refactor buildCreateBody to no longer take a raw body string, and try JSON input first before falling back to flag-built payloads. Update CLI signatures, help text, and examples accordingly, and add the monitor entry to the SKILL.md command list.
2026-05-12 11:05:40 -04:00
Developers Digest 6890170328 rename monitor --status to --state to avoid global flag collision 2026-05-12 10:59:59 -04:00
Developers Digest e576ca35bc add monitor command (create/list/get/update/delete/run/checks) 2026-05-12 10:57:48 -04:00
Developers Digest efeb34d3fb Merge pull request #107 from firecrawl/docs/update-cli-version-refs
Update README.md
2026-05-05 16:43:51 +00:00
Developers Digest 34d8a072fc Update README.md 2026-05-05 12:43:13 -04:00
Developers Digest 42b990d06e Merge pull request #106 from firecrawl/docs/update-cli-version-refs
Update CLI version references
v1.16.2
2026-05-05 14:12:58 +00:00
Developers Digest 0aec57ad08 bump version to 1.16.2 2026-05-05 10:11:53 -04:00
Developers Digest 3cd5eadf9a update cli version references 2026-05-05 10:09:35 -04:00
Developers Digest c522f27ad4 Merge pull request #105 from firecrawl/update-gaps
Improvements
v1.16.1
2026-05-05 12:17:41 +00:00
Developers Digest 1c3c5ab02d bump version to 1.16.1 2026-05-04 12:06:22 -04:00
Developers Digest db445ae1f6 remove unsupported scrape webhook flag 2026-05-04 11:08:10 -04:00
Developers Digest f737873e9d Add webhook/cancel support and JSON parsing
Add support for webhook configuration and canceling jobs across agent, crawl, and scrape commands. Introduce JSON parsing helpers and CLI options for schema, actions, scrape-options, proxy, and webhook (inline or file), and validate payload shapes. Extend types to include webhook/cancel fields and normalize agent statuses to include "cancelled", updating polling and status handling accordingly. Propagate webhook/scrapeOptions through command handlers and improve CLI behavior for global --status handling and format resolution.
2026-05-04 10:56:23 -04:00
Gergő Móricz 3c6ac28a0c Merge pull request #103 from firecrawl/mog/parse-api
feat: parse command (ENG-4830)
v1.16.0
2026-04-27 17:24:38 +02:00
Abimael Martell d0145f4e62 feat: add --lockdown flag to scrape (#104)
* feat: add --lockdown-mode flag to scrape

* rename --lockdown-mode to --lockdown
2026-04-22 15:19:02 -07:00
Developers Digest aaca75fd1b bump version to 1.16.0 2026-04-22 11:09:17 -04:00
Developers Digest 1f8add95eb note 50 mb upload limit in parse skill 2026-04-22 09:47:17 -04:00
Developers Digest 1cbf76344d refine firecrawl-parse skill 2026-04-22 09:45:44 -04:00
Developers Digest 58df656735 drop --only-main-content from parse skill
option exists on api but isn't meaningful for pdf/docx/xlsx - no nav/footer/sidebar chrome to strip on local documents.
2026-04-22 09:38:02 -04:00
Developers Digest 33d6b3ba64 align parse skill with /v2/parse api ground truth
add .htm/.xhtml to supported list, add --timeout option. mirrors ParseFile/ParseOptions from firecrawl core (commit c7993d7).
2026-04-22 09:37:44 -04:00
Developers Digest 0101fc2e68 trim parse skill: less is more
cut to essentials. match density of firecrawl-map. dropped core-capability section, other-formats section, verbose tips.
2026-04-22 09:34:38 -04:00
Developers Digest 8985ddce01 bias parse skill toward save-to-file, drop weak formats
default pattern: parse to .firecrawl/ then grep/read. removed links/images/rawhtml from skill - kept markdown/html/summary (the formats that work cleanly on all supported file types).
2026-04-22 09:34:08 -04:00
Developers Digest 031020fa24 lead parse skill with markdown, demote format matrix
markdown is the 90% use case. moved formats table to secondary 'other formats' section. kept format availability caveat (links/images empty for pdfs).
2026-04-22 09:28:08 -04:00
Developers Digest 198b539648 add firecrawl-parse skill
covers local file parsing (pdf/docx/xlsx/etc) with summary and query shortcuts. registers in firecrawl-cli hub.
2026-04-22 09:21:01 -04:00
mogery 16e09f6339 feat: parse command 2026-04-21 18:15:39 +01:00
Developers Digest fefadc0e5b bump version to 1.15.2 v1.15.2 2026-04-16 12:17:44 -04:00
Developers Digest bc2c6d93a8 Switch agent scaffold to web-agent repo
Update vendored scaffold references and default remote to use firecrawl/web-agent. Adjusted header comments in create.ts, create-flow.ts, credentials.ts, manifest.ts, scaffold.ts, and ui.ts, and changed DEFAULT_REMOTE in manifest.ts from 'firecrawl/firecrawl-agent' to 'firecrawl/web-agent' so the scaffolder clones the web-agent repo for templates.
2026-04-16 12:16:44 -04:00
Developers Digest e55c2a2752 Merge pull request #98 from firecrawl/cli-implementation
bump version to 1.15.1
v1.15.1
2026-04-16 00:28:57 +00:00
Developers Digest 535c23283b bump version to 1.15.1 2026-04-15 20:27:10 -04:00
Developers Digest ffb0e9ef2b Merge pull request #97 from firecrawl/cli-implementation
Cli implementation
2026-04-15 17:59:04 +00:00
Developers Digest 47af8daf5c chore: friendlier error when default clone fails 2026-04-15 13:58:19 -04:00
Developers Digest b7c16d0df6 feat: vendor agent scaffolder into firecrawl-cli
Replaces the `npx firecrawl-agent-cli` delegator with an in-process
scaffolder vendored from firecrawl/firecrawl-agent. No separate npm
package for the agent CLI — the root firecrawl-cli clones the public
agent repo at runtime to fetch templates + agent-core.

- Vendor under src/utils/agent-scaffold/ (manifest, scaffold,
  credentials, ui, create-flow). Upstream-tracked; keep in sync.
- manifest.ts: strip the "bundled next to CLI" branch (doesn't apply
  here), always clone the public repo. Nested-manifest fallback
  handles the current `.internal/cli/agent-manifest.json` location.
- Extract handleCreate from upstream init.ts; drop the commander
  wrapper since the root CLI owns the command surface.
- create.ts now lazy-imports the scaffolder so non-create paths stay
  snappy.

Smoke-tested end-to-end against a local agent repo via --from: next
template scaffolds correctly with agent-core, .env.local, and
expected file layout.
2026-04-15 13:56:17 -04:00
Developers Digest 37fe1778b6 Merge pull request #96 from firecrawl/cli-implementation
feat:`firecrawl create agent` command
v1.15.0
2026-04-15 17:31:38 +00:00
Developers Digest fa0b300209 bump version to 1.15.0 2026-04-15 13:31:03 -04:00
Developers Digest 39bd5b7e48 feat: hidden firecrawl create agent command
Wires a hidden `firecrawl create <kind>` command tree into the root CLI.
Only the `agent` kind is registered today; it delegates to
`npx -y firecrawl-agent-cli create` with full flag passthrough so the
agent repo remains the single source of truth for templates.

The command is hidden from --help until `firecrawl-agent-cli` is on
npm. Flip to visible by removing `{ hidden: true }` in index.ts.

Surface:
  firecrawl create agent [name] [-t next|express|library]
  firecrawl create agent [name] --provider <p> --model <m>
  firecrawl create agent [name] --api-key <fc-key> --key anthropic=sk-...
  firecrawl create agent [name] --from user/repo
2026-04-15 13:23:23 -04:00
Eric Ciarla 959e570d9c Minor copy updates 2026-04-14 20:28:25 -04:00