465 Commits

Author SHA1 Message Date
Developers Digest 45f7987618 Merge branch 'jonathan/monitoring-2' of https://github.com/firecrawl/cli into jonathan/monitoring-2 2026-05-25 13:45:05 -04:00
Developers Digest 45690534ed Add monitor goal/page flags, tests, and docs
Export and update monitor creation helpers to accept a --goal and single --page shorthand (constructs urls from page when provided) and include goal in the request body. Add CLI options and help text for --goal and --page, support goal on monitor update, and adjust example usage. Add unit tests for buildCreateBody covering goal and page behavior. Update README and SKILL docs to document monitor usage and guidance. Bump package version to 1.18.1.
2026-05-25 13:43:23 -04:00
Developers Digest 3ed98eec7c Add monitor goal/page flags, tests, and docs
Export and update monitor creation helpers to accept a --goal and single --page shorthand (constructs urls from page when provided) and include goal in the request body. Add CLI options and help text for --goal and --page, support goal on monitor update, and adjust example usage. Add unit tests for buildCreateBody covering goal and page behavior. Update README and SKILL docs to document monitor usage and guidance. Bump package version to 1.18.1.
2026-05-25 13:20:48 -04:00
Developers Digest 5ddca4b929 Merge pull request #114 from firecrawl/monitoring-goals
monitor create: add --goal flag
2026-05-25 12:53:57 -04:00
Developers Digest 623574bad3 monitor create: add --goal flag 2026-05-22 17:32:25 -04:00
Nicolas 846f111e66 Merge pull request #109 from firecrawl/monitoring
feat(monitoring): implement monitoring
v1.18.0
2026-05-17 12:54:34 -04:00
Nicolas c3e8c8a931 Nick: 2026-05-17 12:51:44 -04:00
Nicolas dac0d071c1 Update package.json 2026-05-17 12:50:26 -04:00
Nicolas f873e5bfd2 Merge branch 'main' into monitoring 2026-05-17 12:48:54 -04:00
Nicolas f912108a64 Update SKILL.md 2026-05-17 12:48:42 -04:00
Eric Ciarla 32309be1c8 Add workflows to cli! v1.17.1 2026-05-15 09:44:34 -04:00
Nicolas f448fc25b6 Merge pull request #110 from firecrawl/nsc/search-feedback
(feat/search) Search feedback
v1.17.0
2026-05-14 15:42:06 -04:00
Nicolas 4e0337677d Merge branch 'main' into nsc/search-feedback 2026-05-14 14:50:31 -04:00
Nicolas 9fad8ca542 Update package.json 2026-05-14 14:34:08 -04:00
Nicolas 60925e5e9f Nick: search feedback 2026-05-14 14:33:29 -04:00
Developers Digest e251e6f012 bump @mendable/firecrawl-js to 4.22.2; document why monitor still uses raw fetch 2026-05-12 11:22:33 -04:00
Developers Digest 84140d9af1 monitor: rename --urls to --scrape-urls to pair with --crawl-url 2026-05-12 11:13:18 -04:00
Developers Digest 19ae52cc73 monitor: accept JSON via positional file or piped stdin; document in skill 2026-05-12 11:06:00 -04:00
Developers Digest 933930b1fe monitor: accept JSON file/stdin and remove --body
Allow monitor create/update commands to consume a JSON payload from a positional file argument or piped stdin (use '-' to force stdin). Introduce async readJsonPayload helper, refactor buildCreateBody to no longer take a raw body string, and try JSON input first before falling back to flag-built payloads. Update CLI signatures, help text, and examples accordingly, and add the monitor entry to the SKILL.md command list.
2026-05-12 11:05:40 -04:00
Developers Digest 6890170328 rename monitor --status to --state to avoid global flag collision 2026-05-12 10:59:59 -04:00
Developers Digest e576ca35bc add monitor command (create/list/get/update/delete/run/checks) 2026-05-12 10:57:48 -04:00
Developers Digest efeb34d3fb Merge pull request #107 from firecrawl/docs/update-cli-version-refs
Update README.md
2026-05-05 16:43:51 +00:00
Developers Digest 34d8a072fc Update README.md 2026-05-05 12:43:13 -04:00
Developers Digest 42b990d06e Merge pull request #106 from firecrawl/docs/update-cli-version-refs
Update CLI version references
v1.16.2
2026-05-05 14:12:58 +00:00
Developers Digest 0aec57ad08 bump version to 1.16.2 2026-05-05 10:11:53 -04:00
Developers Digest 3cd5eadf9a update cli version references 2026-05-05 10:09:35 -04:00
Developers Digest c522f27ad4 Merge pull request #105 from firecrawl/update-gaps
Improvements
v1.16.1
2026-05-05 12:17:41 +00:00
Developers Digest 1c3c5ab02d bump version to 1.16.1 2026-05-04 12:06:22 -04:00
Developers Digest db445ae1f6 remove unsupported scrape webhook flag 2026-05-04 11:08:10 -04:00
Developers Digest f737873e9d Add webhook/cancel support and JSON parsing
Add support for webhook configuration and canceling jobs across agent, crawl, and scrape commands. Introduce JSON parsing helpers and CLI options for schema, actions, scrape-options, proxy, and webhook (inline or file), and validate payload shapes. Extend types to include webhook/cancel fields and normalize agent statuses to include "cancelled", updating polling and status handling accordingly. Propagate webhook/scrapeOptions through command handlers and improve CLI behavior for global --status handling and format resolution.
2026-05-04 10:56:23 -04:00
Gergő Móricz 3c6ac28a0c Merge pull request #103 from firecrawl/mog/parse-api
feat: parse command (ENG-4830)
v1.16.0
2026-04-27 17:24:38 +02:00
Abimael Martell d0145f4e62 feat: add --lockdown flag to scrape (#104)
* feat: add --lockdown-mode flag to scrape

* rename --lockdown-mode to --lockdown
2026-04-22 15:19:02 -07:00
Developers Digest aaca75fd1b bump version to 1.16.0 2026-04-22 11:09:17 -04:00
Developers Digest 1f8add95eb note 50 mb upload limit in parse skill 2026-04-22 09:47:17 -04:00
Developers Digest 1cbf76344d refine firecrawl-parse skill 2026-04-22 09:45:44 -04:00
Developers Digest 58df656735 drop --only-main-content from parse skill
option exists on api but isn't meaningful for pdf/docx/xlsx - no nav/footer/sidebar chrome to strip on local documents.
2026-04-22 09:38:02 -04:00
Developers Digest 33d6b3ba64 align parse skill with /v2/parse api ground truth
add .htm/.xhtml to supported list, add --timeout option. mirrors ParseFile/ParseOptions from firecrawl core (commit c7993d7).
2026-04-22 09:37:44 -04:00
Developers Digest 0101fc2e68 trim parse skill: less is more
cut to essentials. match density of firecrawl-map. dropped core-capability section, other-formats section, verbose tips.
2026-04-22 09:34:38 -04:00
Developers Digest 8985ddce01 bias parse skill toward save-to-file, drop weak formats
default pattern: parse to .firecrawl/ then grep/read. removed links/images/rawhtml from skill - kept markdown/html/summary (the formats that work cleanly on all supported file types).
2026-04-22 09:34:08 -04:00
Developers Digest 031020fa24 lead parse skill with markdown, demote format matrix
markdown is the 90% use case. moved formats table to secondary 'other formats' section. kept format availability caveat (links/images empty for pdfs).
2026-04-22 09:28:08 -04:00
Developers Digest 198b539648 add firecrawl-parse skill
covers local file parsing (pdf/docx/xlsx/etc) with summary and query shortcuts. registers in firecrawl-cli hub.
2026-04-22 09:21:01 -04:00
mogery 16e09f6339 feat: parse command 2026-04-21 18:15:39 +01:00
Developers Digest fefadc0e5b bump version to 1.15.2 v1.15.2 2026-04-16 12:17:44 -04:00
Developers Digest bc2c6d93a8 Switch agent scaffold to web-agent repo
Update vendored scaffold references and default remote to use firecrawl/web-agent. Adjusted header comments in create.ts, create-flow.ts, credentials.ts, manifest.ts, scaffold.ts, and ui.ts, and changed DEFAULT_REMOTE in manifest.ts from 'firecrawl/firecrawl-agent' to 'firecrawl/web-agent' so the scaffolder clones the web-agent repo for templates.
2026-04-16 12:16:44 -04:00
Developers Digest e55c2a2752 Merge pull request #98 from firecrawl/cli-implementation
bump version to 1.15.1
v1.15.1
2026-04-16 00:28:57 +00:00
Developers Digest 535c23283b bump version to 1.15.1 2026-04-15 20:27:10 -04:00
Developers Digest ffb0e9ef2b Merge pull request #97 from firecrawl/cli-implementation
Cli implementation
2026-04-15 17:59:04 +00:00
Developers Digest 47af8daf5c chore: friendlier error when default clone fails 2026-04-15 13:58:19 -04:00
Developers Digest b7c16d0df6 feat: vendor agent scaffolder into firecrawl-cli
Replaces the `npx firecrawl-agent-cli` delegator with an in-process
scaffolder vendored from firecrawl/firecrawl-agent. No separate npm
package for the agent CLI — the root firecrawl-cli clones the public
agent repo at runtime to fetch templates + agent-core.

- Vendor under src/utils/agent-scaffold/ (manifest, scaffold,
  credentials, ui, create-flow). Upstream-tracked; keep in sync.
- manifest.ts: strip the "bundled next to CLI" branch (doesn't apply
  here), always clone the public repo. Nested-manifest fallback
  handles the current `.internal/cli/agent-manifest.json` location.
- Extract handleCreate from upstream init.ts; drop the commander
  wrapper since the root CLI owns the command surface.
- create.ts now lazy-imports the scaffolder so non-create paths stay
  snappy.

Smoke-tested end-to-end against a local agent repo via --from: next
template scaffolds correctly with agent-core, .env.local, and
expected file layout.
2026-04-15 13:56:17 -04:00
Developers Digest 37fe1778b6 Merge pull request #96 from firecrawl/cli-implementation
feat:`firecrawl create agent` command
v1.15.0
2026-04-15 17:31:38 +00:00