Commit Graph

244 Commits

Author SHA1 Message Date
Developers Digest f5d8c635c9 strip inherited npm_* env vars before nested npx calls
when this cli is launched via 'npx -y firecrawl-cli@VERSION', npm injects
npm_command/npm_lifecycle_event/npm_execpath/INIT_CWD into the process
env. those vars leak into nested execSync('npx -y skills add ...') calls
and cause the loop's second iteration to silently exit after the first
install completes — published 1.14.0 only installs from firecrawl/cli
even though SKILL_REPOS contains both repos.

cleanNpmEnv() in skills-install.ts strips those vars; init.ts and
setup.ts pass it as the env to every nested execSync. added a
regression test that primes process.env with the leaking vars and
asserts every install call sees a clean env. bumped to 1.14.1.
2026-04-10 09:58:30 -04:00
Developers Digest a9748148a8 install skills from firecrawl/skills in addition to firecrawl/cli
onboarding (init) and setup skills now loop over a SKILL_REPOS list
so both the core cli skills and the build skills repo get installed
through the same npx/native paths. buildSkillsInstallArgs and
installSkillsNative take a repo parameter (defaulting to firecrawl/cli
for back compat). tests updated to assert both install invocations.
2026-04-10 09:34:36 -04:00
Developers Digest a7e6712eb5 remove legacy browser references from shared prompts and skill metadata 2026-04-08 22:20:49 -04:00
Developers Digest 2618c20d8d clean up cli: rename instruct to interact, hide browser, group experimental commands
- rename skills/firecrawl-instruct → firecrawl-interact + update all cross-references
- hide deprecated browser command from --help (still works when called directly)
- group download, claude, codex, opencode under `firecrawl experimental` (alias: `firecrawl x`)
- remove browser references from passthrough system prompt quick reference
2026-04-08 22:17:47 -04:00
Developers Digest 8bb27a5ce5 Merge pull request #77 from firecrawl/install-sh
add native skill installer and post-install setup flow
2026-03-25 20:24:10 +00:00
Developers Digest 49c5484f12 add native skill installer and post-install setup flow
- new skills-native.ts: replicates `npx skills add` without requiring
  Node.js — clones repo, copies skills to ~/.agents/skills/, creates
  relative symlinks to detected agent dirs (claude, cursor, etc.)
- setup.ts + init.ts: try npx first, fall back to native installer
- install.sh: after binary installs, prompt to continue with
  `firecrawl init --skip-install` for login + skills + integrations
2026-03-25 16:20:59 -04:00
Nicolas 40b3fdd9a3 Nick: improvements 2026-03-23 17:17:03 -03:00
Nicolas 726d90f677 Nick: 2026-03-23 12:56:44 -03:00
Nicolas c084d98486 Nick: 2026-03-23 12:54:22 -03:00
Nicolas 954d3830e4 Nick: 2026-03-22 21:23:48 -03:00
Nicolas 0bdf2b7426 Nick: 2026-03-22 20:25:44 -03:00
Nicolas 5abd341e30 Nick: updates 2026-03-19 15:44:35 -07:00
Nicolas 8607c7797d Nick: fixes 2026-03-18 16:46:50 -07:00
Nicolas be2547b96f Nick: 2026-03-18 16:26:04 -07:00
Nicolas af20982297 Nick: 2026-03-18 15:55:05 -07:00
Developers Digest 7ba546f5ce add --query flag for query format support 2026-03-12 11:39:46 -04:00
Developers Digest 3cd636cc91 fix type error in browser.ts interactiveLiveViewUrl access 2026-03-10 17:09:02 -04:00
Developers Digest 6f691ac3b4 update install script 2026-03-10 17:03:10 -04:00
Developers Digest 8037884e60 add firecrawl -y shorthand for init --all --browser
npx -y firecrawl-cli -y now runs the full non-interactive setup:
install globally, browser auth, install all skills to all agents.
2026-03-10 16:55:23 -04:00
Developers Digest 65735a18c0 fix setup skills missing npx -y flag
Without -y, npx prompts "Need to install the following packages: skills.
Ok to proceed?" which hangs in scripts and CI.
2026-03-10 16:50:04 -04:00
Developers Digest 50ca954490 make setup skills install globally with all skills by default 2026-03-10 16:34:05 -04:00
Developers Digest 906a0204f3 add --full-depth to skills install, -y defaults to browser auth and --all 2026-03-09 12:05:27 -04:00
Nicolas ad0970df1d Nick: formatting 2026-03-06 18:56:54 -08:00
Nicolas 9befd6029a Nick: more workflows + interactive live view 2026-03-06 18:56:11 -08:00
Developers Digest b51cb3f250 fix init --all going interactive instead of skipping prompts
--all implies --yes per the help text, but handleInitCommand only
checked options.yes to enter non-interactive mode. Now it checks
options.all too.
2026-03-06 21:04:58 -05:00
Developers Digest 9a4b31e443 shop workflow: browser-first with live view and site preference 2026-03-06 20:54:57 -05:00
Developers Digest 84e308ea70 Stub OpenCode backend; add sites input to shop
Replace OpenCode backend implementation with a coming-soon stub: update displayName to "OpenCode (coming soon)" and make buildArgs print a message and exit to prevent use. In the shop workflow, add a new "sites" input (collected and returned), include it in the constructed user message, tweak prompt wording for context, add an instruction to work sequentially, and generalize the buy phase (remove hard dependency on the amazon profile). Minor UX and wording refinements included.
2026-03-06 20:41:12 -05:00
Developers Digest eb260d79a8 Add live-view browser launch and swap tools block
Add explicit guidance to launch a browser session with Live View before performing browser operations (run `firecrawl browser launch-session --json` and surface the Live View URL immediately). Insert this instruction into the experimental shared prompts and the passthrough system prompt. Also update the shop workflow to use `QA_TOOLS_BLOCK` instead of `FIRECRAWL_TOOLS_BLOCK`.
2026-03-06 20:36:30 -05:00
Developers Digest f8613d89ae Bump SDK, update docs & fix live view URL
Upgrade @mendable/firecrawl-js to v4.15.3 and remove the local workspace override. Revise README examples to use the unified firecrawl CLI commands and expand workflow examples. Update browser launch handling to use .liveViewUrl (and adjust jq examples) instead of the previous interactiveLiveViewUrl fallback.
2026-03-06 20:29:23 -05:00
Developers Digest 120303e83c Pass integration='cli' to SDK calls; update tests & docs
Add an explicit integration: 'cli' flag to SDK call options across commands (agent, browser, crawl, map, scrape, search) so the backend knows the CLI origin. Update browser launch/quick-execute defaults to include integration and adjust scrape params typing. Update tests to assert the integration field. Persist API URL when only a custom --api-url is provided (no api-key) during login, and use global CLI options when handling login invocation. Bump package version to 1.9.4, add keywords and upgrade @mendable/firecrawl-js to 4.15.1, and add a "Testing Workflows Locally" section to README with examples for Claude, Codex, and OpenCode CLIs.
2026-03-06 20:25:17 -05:00
Ashot Nazaryan 1e6a118b31 fix login on self-hosted setup 2026-03-04 19:14:21 -08:00
Nicolas 52cedea9ef Nick: 2026-03-02 11:30:59 -08:00
Nicolas 71c336a618 Nick: 2026-03-02 10:03:33 -08:00
Developers Digest f2121bfe8c agent-workflow-poc 2026-03-01 12:06:40 -05:00
Developers Digest 687fd54d83 Retry browser quick-execute on expired session 2026-02-27 14:24:01 -05:00
Developers Digest 396fb5149e Replace write-mode with --no-save-changes 2026-02-26 16:10:20 -05:00
Developers Digest 5daaa83816 Rename persistentSession to profile 2026-02-26 15:11:05 -05:00
Developers Digest b45abd9d03 add persistent session to browser cmd + skill + help 2026-02-26 14:58:53 -05:00
Developers Digest 6ab4a487a8 Merge pull request #40 from firecrawl/pull-env
feat(env): Add 'env' command to pull API key
2026-02-23 16:29:31 -05:00
Developers Digest c79f8c403f fix download to map from origin 2026-02-23 10:29:02 -05:00
Developers Digest 2894d3eeb0 updates 2026-02-20 14:54:05 -05:00
Developers Digest aee3bd2982 drop stream option + remove legacy local bash + default to remote agent-browser 2026-02-20 14:20:44 -05:00
Developers Digest a94af0d6ed update incrementing in progress bar 2026-02-19 18:06:40 -05:00
Developers Digest 33f41bc022 Add dl command to map + scrape with options with app router style download organization 2026-02-19 17:58:08 -05:00
Developers Digest d139aa48bd Add multi-URL scrape support
Allow scraping multiple URLs concurrently and save each result to .firecrawl/. Adds handleMultiScrapeCommand and urlToFilename helper in src/commands/scrape.ts to run concurrent scrapes, write outputs to .firecrawl/, emit progress/errors, and exit non-zero if all fail. Update CLI in src/index.ts to accept multiple positional URLs and --url, deduplicate inputs, infer formats from positional args or flags, and route single-URL requests to the existing handler. Update README.md and skills/firecrawl-cli/SKILL.md to document multiple-URL usage and examples.
2026-02-19 14:07:45 -05:00
Developers Digest 62e8e9b66c Add 'env' command to pull API key
Introduce a new CLI command to pull the authenticated FIRECRAWL_API_KEY into a local .env file. Adds src/commands/env.ts which implements handleEnvPullCommand(options) — it gets the API key (via getApiKey or ensureAuthenticated), and creates/updates/appends the FIRECRAWL_API_KEY line in the target env file, with an --overwrite flag to replace an existing key. Also registers the command in src/index.ts with options (-f/--file and --overwrite). This provides a convenient way for developers to sync their API key into project .env files.
2026-02-18 22:26:48 -05:00
Nicolas e5c431ef8e Nick: 2026-02-18 13:53:34 -08:00
Nicolas 69ad2c00e1 Nick: init 2026-02-18 12:02:22 -08:00
Developers Digest 52821789ea Add init command for skills and MCP
Introduce a new CLI init command to install Firecrawl integrations. Adds src/commands/init.ts which implements handleInitCommand with subcommands 'skills' and 'mcp' (installSkills and installMcp). Both flows invoke npx helpers via execSync and accept --global and --agent options; installMcp requires an API key (getApiKey / FIRECRAWL_API_KEY) and injects it into the environment. Registers the command in src/index.ts and updates README.md with usage examples for `firecrawl init skills` and `firecrawl init mcp` (including the npx add-mcp invocation). Exits on failures to propagate errors to the caller.
2026-02-18 10:57:25 -05:00
Developers Digest 68ec055d40 Update browser.ts 2026-02-17 13:29:11 -05:00