Commit Graph

52 Commits

Author SHA1 Message Date
Eric Ciarla 32309be1c8 Add workflows to cli! 2026-05-15 09:44:34 -04:00
Developers Digest 34d8a072fc Update README.md 2026-05-05 12:43:13 -04:00
Developers Digest 0aec57ad08 bump version to 1.16.2 2026-05-05 10:11:53 -04:00
Developers Digest 3cd5eadf9a update cli version references 2026-05-05 10:09:35 -04:00
Abimael Martell d0145f4e62 feat: add --lockdown flag to scrape (#104)
* feat: add --lockdown-mode flag to scrape

* rename --lockdown-mode to --lockdown
2026-04-22 15:19:02 -07:00
Eric Ciarla 959e570d9c Minor copy updates 2026-04-14 20:28:25 -04:00
Eric Ciarla cd2c3e1e01 Updates 2026-04-11 13:51:47 -04:00
Developers Digest 1b48a69d99 swap interact example to action-oriented search + filter flow 2026-04-10 11:58:53 -04:00
Developers Digest 9d6cc65c4c split next-steps into web vs build sections + friendly install labels
During install, show "Installing core firecrawl skills..." and
"Installing skills to build with firecrawl..." instead of the raw repo
names firecrawl/cli and firecrawl/skills. SKILL_REPO_LABELS map drives
the friendly text.

In the next-steps summary, split into two distinct groupings:
  1. "Connect & interact with the web (direct or in your AI agent)"
     with scrape/search/interact examples showing the natural language
     prompt next to the equivalent CLI command.
  2. "Building with firecrawl?" at the bottom, pointing at the build
     skills with a concrete business example.

MCP + --help entries sit between the two sections as general utilities.
Bumped to 1.14.7.
2026-04-10 11:52:13 -04:00
Developers Digest 6da95bba24 use firecrawl-specific business example in next-steps tip 2026-04-10 11:04:36 -04:00
Developers Digest f91f069382 rephrase build-skills tip with concrete example, drop em dash 2026-04-10 11:01:50 -04:00
Developers Digest 6ef1aa565c add 'start building' tip to next-steps summary 2026-04-10 11:00:19 -04:00
Developers Digest a7aa071f7a tighten next-steps summary and surface skill count
Parse '(Found|Installed) N skills' from captured npx skills output and
sum across both repos so the post-install summary shows
"✓ Installed 14 skills across your AI coding agents" instead of vague
text.

Collapse the next-steps block from 18 lines to 7: drop the 4 example
prompts in favor of one of each (AI prompt + direct CLI), plus the
MCP install hint and the --help pointer. Each entry uses padded labels
("Ask your AI:", "Run direct: ", "Add MCP:    ", "All commands:") so
the commands align in a column.

stepIntegrations and runNonInteractive both thread the count through
to printNextSteps. Tests still mock execSync as undefined, so
parseSkillCount handles the empty case. Bumped to 1.14.3.
2026-04-10 10:25:14 -04:00
Developers Digest fa735ff336 quiet skill install output and add next-steps summary
Replace the noisy 'npx skills add' inherited stdout (banner, +/symlink
table, security report, ~80 lines per repo) with a single line per repo:
"  ✓ firecrawl/cli" / "  ✓ firecrawl/skills". TTY runs get a transient
"↓ <repo>" indicator while the install is in flight; non-TTY runs (CI,
piped) get only the final line.

Replace the trailing "Setup complete!" line with a printNextSteps()
block that surfaces:
  - what just happened (skills installed globally)
  - what firecrawl is for (search, scrape, crawl, interact)
  - 4 example prompts (2 build-skill triggers, 2 direct CLI calls)
  - pointer to firecrawl --help

Both interactive and non-interactive init paths use the same helpers,
so output is consistent regardless of how users enter the flow.
Bumped to 1.14.2.
2026-04-10 10:17:42 -04:00
Developers Digest f5d8c635c9 strip inherited npm_* env vars before nested npx calls
when this cli is launched via 'npx -y firecrawl-cli@VERSION', npm injects
npm_command/npm_lifecycle_event/npm_execpath/INIT_CWD into the process
env. those vars leak into nested execSync('npx -y skills add ...') calls
and cause the loop's second iteration to silently exit after the first
install completes — published 1.14.0 only installs from firecrawl/cli
even though SKILL_REPOS contains both repos.

cleanNpmEnv() in skills-install.ts strips those vars; init.ts and
setup.ts pass it as the env to every nested execSync. added a
regression test that primes process.env with the leaking vars and
asserts every install call sees a clean env. bumped to 1.14.1.
2026-04-10 09:58:30 -04:00
Developers Digest df7fadc89c bump version to 1.14.0 2026-04-10 09:37:40 -04:00
Developers Digest d1eae86cd9 update readme: add interact docs, move download + workflows under experimental, remove browser section 2026-04-08 22:30:30 -04:00
Developers Digest fe51a55617 pin install references to 1.13.0 instead of @latest 2026-04-08 22:28:29 -04:00
Eric Ciarla f43634890e Update README.md 2026-04-08 17:08:12 -04:00
Nicolas 726d90f677 Nick: 2026-03-23 12:56:44 -03:00
Developers Digest 6f691ac3b4 update install script 2026-03-10 17:03:10 -04:00
Developers Digest f8613d89ae Bump SDK, update docs & fix live view URL
Upgrade @mendable/firecrawl-js to v4.15.3 and remove the local workspace override. Revise README examples to use the unified firecrawl CLI commands and expand workflow examples. Update browser launch handling to use .liveViewUrl (and adjust jq examples) instead of the previous interactiveLiveViewUrl fallback.
2026-03-06 20:29:23 -05:00
Developers Digest 120303e83c Pass integration='cli' to SDK calls; update tests & docs
Add an explicit integration: 'cli' flag to SDK call options across commands (agent, browser, crawl, map, scrape, search) so the backend knows the CLI origin. Update browser launch/quick-execute defaults to include integration and adjust scrape params typing. Update tests to assert the integration field. Persist API URL when only a custom --api-url is provided (no api-key) during login, and use global CLI options when handling login invocation. Bump package version to 1.9.4, add keywords and upgrade @mendable/firecrawl-js to 4.15.1, and add a "Testing Workflows Locally" section to README with examples for Claude, Codex, and OpenCode CLIs.
2026-03-06 20:25:17 -05:00
Developers Digest f2121bfe8c agent-workflow-poc 2026-03-01 12:06:40 -05:00
Developers Digest 33f41bc022 Add dl command to map + scrape with options with app router style download organization 2026-02-19 17:58:08 -05:00
Developers Digest d139aa48bd Add multi-URL scrape support
Allow scraping multiple URLs concurrently and save each result to .firecrawl/. Adds handleMultiScrapeCommand and urlToFilename helper in src/commands/scrape.ts to run concurrent scrapes, write outputs to .firecrawl/, emit progress/errors, and exit non-zero if all fail. Update CLI in src/index.ts to accept multiple positional URLs and --url, deduplicate inputs, infer formats from positional args or flags, and route single-URL requests to the existing handler. Update README.md and skills/firecrawl-cli/SKILL.md to document multiple-URL usage and examples.
2026-02-19 14:07:45 -05:00
Nicolas 527966f96b Update README.md 2026-02-18 15:36:00 -08:00
Nicolas 1054ae2937 Update README.md 2026-02-18 14:05:32 -08:00
Nicolas 5d6394af8a Update README.md 2026-02-18 14:02:11 -08:00
Nicolas e5c431ef8e Nick: 2026-02-18 13:53:34 -08:00
Nicolas f521667231 Update README.md 2026-02-18 13:09:28 -08:00
Nicolas 6e633d6ecb Update README.md 2026-02-18 13:08:46 -08:00
Nicolas 69ad2c00e1 Nick: init 2026-02-18 12:02:22 -08:00
Developers Digest 52821789ea Add init command for skills and MCP
Introduce a new CLI init command to install Firecrawl integrations. Adds src/commands/init.ts which implements handleInitCommand with subcommands 'skills' and 'mcp' (installSkills and installMcp). Both flows invoke npx helpers via execSync and accept --global and --agent options; installMcp requires an API key (getApiKey / FIRECRAWL_API_KEY) and injects it into the environment. Registers the command in src/index.ts and updates README.md with usage examples for `firecrawl init skills` and `firecrawl init mcp` (including the npx add-mcp invocation). Exits on failures to propagate errors to the caller.
2026-02-18 10:57:25 -05:00
Nicolas 05f28c18c3 Update README.md 2026-02-16 19:26:09 -08:00
Developers Digest ab49da2c21 docs: update CLI docs for v1.4.0 2026-02-16 20:20:51 -05:00
Developers Digest 0f1e6545ec browser init 2026-02-13 13:01:08 -05:00
Abimael Martell 5948945fd1 add agent docs 2026-02-03 16:39:47 -08:00
Abimael Martell 8845a2fc08 Add support for local/custom API URLs (#20)
* Add support for local/custom API URLs

For custom API URLs (e.g., local development with Docker), the CLI now:
- Skips API key requirement when using non-cloud URLs
- Allows optional API key input during login
- Skips browser auth flow for custom URLs

This enables use with local Firecrawl instances that have
USE_DB_AUTHENTICATION=false.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Add --api-url option to commands

Add --api-url flag at both global and command levels (scrape, crawl,
map, search, credit-usage) similar to --api-key. When a custom API URL
is provided, authentication is skipped allowing requests to local or
self-hosted Firecrawl instances without an API key.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* docs: Add --api-url option documentation

Document the --api-url option for self-hosted and local development
use cases in the README, including examples for environment variables
and CI/CD usage.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* docs: Add --api-url to login and config examples

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-30 16:48:27 -08:00
Abimael Martell 1ded7e23e4 Remove extra blank lines in README.md (#18)
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-30 16:16:27 -08:00
Nicolas 463b7a1a88 Update README.md 2026-01-26 17:23:04 -08:00
Developers Digest 8584f6ced8 Update concurrency label to 'parallel scrape limit'
Replaces 'parallel scrape/crawl limit' with 'parallel scrape limit' in status output, README, and SKILL.md for clarity and consistency.
2026-01-23 08:21:30 -05:00
Developers Digest 45b63b2b02 Add --status command to display CLI and account info
Introduces a new --status flag to the CLI, showing version, authentication status, concurrency limits, and credit usage. Updates documentation and skill instructions to reflect the new command. Increments package version to 1.1.0.
2026-01-23 08:12:23 -05:00
Nicolas dc2120cf77 Update README.md 2026-01-22 14:14:32 -03:00
Nicolas d119e408d3 Update README.md 2026-01-22 14:13:35 -03:00
Nicolas e8cc94b24d Nick: 2026-01-22 12:34:58 -03:00
Nicolas 97c268d6b2 Nick: 2026-01-21 15:15:31 -03:00
Nicolas d26fbd044a Nick: search 2026-01-21 00:20:18 -03:00
Nicolas 4a3d047783 Nick: 2026-01-21 00:09:47 -03:00
Abimael Martell 5c542f88ec usage example on readme 2026-01-07 14:25:44 -08:00