Commit Graph

207 Commits

Author SHA1 Message Date
Developers Digest bc2c6d93a8 Switch agent scaffold to web-agent repo
Update vendored scaffold references and default remote to use firecrawl/web-agent. Adjusted header comments in create.ts, create-flow.ts, credentials.ts, manifest.ts, scaffold.ts, and ui.ts, and changed DEFAULT_REMOTE in manifest.ts from 'firecrawl/firecrawl-agent' to 'firecrawl/web-agent' so the scaffolder clones the web-agent repo for templates.
2026-04-16 12:16:44 -04:00
Developers Digest 47af8daf5c chore: friendlier error when default clone fails 2026-04-15 13:58:19 -04:00
Developers Digest b7c16d0df6 feat: vendor agent scaffolder into firecrawl-cli
Replaces the `npx firecrawl-agent-cli` delegator with an in-process
scaffolder vendored from firecrawl/firecrawl-agent. No separate npm
package for the agent CLI — the root firecrawl-cli clones the public
agent repo at runtime to fetch templates + agent-core.

- Vendor under src/utils/agent-scaffold/ (manifest, scaffold,
  credentials, ui, create-flow). Upstream-tracked; keep in sync.
- manifest.ts: strip the "bundled next to CLI" branch (doesn't apply
  here), always clone the public repo. Nested-manifest fallback
  handles the current `.internal/cli/agent-manifest.json` location.
- Extract handleCreate from upstream init.ts; drop the commander
  wrapper since the root CLI owns the command surface.
- create.ts now lazy-imports the scaffolder so non-create paths stay
  snappy.

Smoke-tested end-to-end against a local agent repo via --from: next
template scaffolds correctly with agent-core, .env.local, and
expected file layout.
2026-04-15 13:56:17 -04:00
Developers Digest 39bd5b7e48 feat: hidden firecrawl create agent command
Wires a hidden `firecrawl create <kind>` command tree into the root CLI.
Only the `agent` kind is registered today; it delegates to
`npx -y firecrawl-agent-cli create` with full flag passthrough so the
agent repo remains the single source of truth for templates.

The command is hidden from --help until `firecrawl-agent-cli` is on
npm. Flip to visible by removing `{ hidden: true }` in index.ts.

Surface:
  firecrawl create agent [name] [-t next|express|library]
  firecrawl create agent [name] --provider <p> --model <m>
  firecrawl create agent [name] --api-key <fc-key> --key anthropic=sk-...
  firecrawl create agent [name] --from user/repo
2026-04-15 13:23:23 -04:00
Nicolas 3193905aa4 Nick: fixes when using -k 2026-04-13 17:58:57 -03:00
Developers Digest 1b48a69d99 swap interact example to action-oriented search + filter flow 2026-04-10 11:58:53 -04:00
Developers Digest 9d6cc65c4c split next-steps into web vs build sections + friendly install labels
During install, show "Installing core firecrawl skills..." and
"Installing skills to build with firecrawl..." instead of the raw repo
names firecrawl/cli and firecrawl/skills. SKILL_REPO_LABELS map drives
the friendly text.

In the next-steps summary, split into two distinct groupings:
  1. "Connect & interact with the web (direct or in your AI agent)"
     with scrape/search/interact examples showing the natural language
     prompt next to the equivalent CLI command.
  2. "Building with firecrawl?" at the bottom, pointing at the build
     skills with a concrete business example.

MCP + --help entries sit between the two sections as general utilities.
Bumped to 1.14.7.
2026-04-10 11:52:13 -04:00
Developers Digest 6da95bba24 use firecrawl-specific business example in next-steps tip 2026-04-10 11:04:36 -04:00
Developers Digest f91f069382 rephrase build-skills tip with concrete example, drop em dash 2026-04-10 11:01:50 -04:00
Developers Digest 6ef1aa565c add 'start building' tip to next-steps summary 2026-04-10 11:00:19 -04:00
Developers Digest a7aa071f7a tighten next-steps summary and surface skill count
Parse '(Found|Installed) N skills' from captured npx skills output and
sum across both repos so the post-install summary shows
"✓ Installed 14 skills across your AI coding agents" instead of vague
text.

Collapse the next-steps block from 18 lines to 7: drop the 4 example
prompts in favor of one of each (AI prompt + direct CLI), plus the
MCP install hint and the --help pointer. Each entry uses padded labels
("Ask your AI:", "Run direct: ", "Add MCP:    ", "All commands:") so
the commands align in a column.

stepIntegrations and runNonInteractive both thread the count through
to printNextSteps. Tests still mock execSync as undefined, so
parseSkillCount handles the empty case. Bumped to 1.14.3.
2026-04-10 10:25:14 -04:00
Developers Digest c2e4856ef5 add mcp install hint to next-steps summary 2026-04-10 10:21:21 -04:00
Developers Digest fa735ff336 quiet skill install output and add next-steps summary
Replace the noisy 'npx skills add' inherited stdout (banner, +/symlink
table, security report, ~80 lines per repo) with a single line per repo:
"  ✓ firecrawl/cli" / "  ✓ firecrawl/skills". TTY runs get a transient
"↓ <repo>" indicator while the install is in flight; non-TTY runs (CI,
piped) get only the final line.

Replace the trailing "Setup complete!" line with a printNextSteps()
block that surfaces:
  - what just happened (skills installed globally)
  - what firecrawl is for (search, scrape, crawl, interact)
  - 4 example prompts (2 build-skill triggers, 2 direct CLI calls)
  - pointer to firecrawl --help

Both interactive and non-interactive init paths use the same helpers,
so output is consistent regardless of how users enter the flow.
Bumped to 1.14.2.
2026-04-10 10:17:42 -04:00
Developers Digest f5d8c635c9 strip inherited npm_* env vars before nested npx calls
when this cli is launched via 'npx -y firecrawl-cli@VERSION', npm injects
npm_command/npm_lifecycle_event/npm_execpath/INIT_CWD into the process
env. those vars leak into nested execSync('npx -y skills add ...') calls
and cause the loop's second iteration to silently exit after the first
install completes — published 1.14.0 only installs from firecrawl/cli
even though SKILL_REPOS contains both repos.

cleanNpmEnv() in skills-install.ts strips those vars; init.ts and
setup.ts pass it as the env to every nested execSync. added a
regression test that primes process.env with the leaking vars and
asserts every install call sees a clean env. bumped to 1.14.1.
2026-04-10 09:58:30 -04:00
Developers Digest a9748148a8 install skills from firecrawl/skills in addition to firecrawl/cli
onboarding (init) and setup skills now loop over a SKILL_REPOS list
so both the core cli skills and the build skills repo get installed
through the same npx/native paths. buildSkillsInstallArgs and
installSkillsNative take a repo parameter (defaulting to firecrawl/cli
for back compat). tests updated to assert both install invocations.
2026-04-10 09:34:36 -04:00
Developers Digest a7e6712eb5 remove legacy browser references from shared prompts and skill metadata 2026-04-08 22:20:49 -04:00
Developers Digest 2618c20d8d clean up cli: rename instruct to interact, hide browser, group experimental commands
- rename skills/firecrawl-instruct → firecrawl-interact + update all cross-references
- hide deprecated browser command from --help (still works when called directly)
- group download, claude, codex, opencode under `firecrawl experimental` (alias: `firecrawl x`)
- remove browser references from passthrough system prompt quick reference
2026-04-08 22:17:47 -04:00
Developers Digest 8bb27a5ce5 Merge pull request #77 from firecrawl/install-sh
add native skill installer and post-install setup flow
2026-03-25 20:24:10 +00:00
Developers Digest 49c5484f12 add native skill installer and post-install setup flow
- new skills-native.ts: replicates `npx skills add` without requiring
  Node.js — clones repo, copies skills to ~/.agents/skills/, creates
  relative symlinks to detected agent dirs (claude, cursor, etc.)
- setup.ts + init.ts: try npx first, fall back to native installer
- install.sh: after binary installs, prompt to continue with
  `firecrawl init --skip-install` for login + skills + integrations
2026-03-25 16:20:59 -04:00
Nicolas 40b3fdd9a3 Nick: improvements 2026-03-23 17:17:03 -03:00
Nicolas 726d90f677 Nick: 2026-03-23 12:56:44 -03:00
Nicolas c084d98486 Nick: 2026-03-23 12:54:22 -03:00
Nicolas 954d3830e4 Nick: 2026-03-22 21:23:48 -03:00
Nicolas 0bdf2b7426 Nick: 2026-03-22 20:25:44 -03:00
Nicolas 5abd341e30 Nick: updates 2026-03-19 15:44:35 -07:00
Nicolas 8607c7797d Nick: fixes 2026-03-18 16:46:50 -07:00
Nicolas be2547b96f Nick: 2026-03-18 16:26:04 -07:00
Nicolas af20982297 Nick: 2026-03-18 15:55:05 -07:00
Developers Digest 7ba546f5ce add --query flag for query format support 2026-03-12 11:39:46 -04:00
Developers Digest 3cd636cc91 fix type error in browser.ts interactiveLiveViewUrl access 2026-03-10 17:09:02 -04:00
Developers Digest 6f691ac3b4 update install script 2026-03-10 17:03:10 -04:00
Developers Digest 8037884e60 add firecrawl -y shorthand for init --all --browser
npx -y firecrawl-cli -y now runs the full non-interactive setup:
install globally, browser auth, install all skills to all agents.
2026-03-10 16:55:23 -04:00
Developers Digest 65735a18c0 fix setup skills missing npx -y flag
Without -y, npx prompts "Need to install the following packages: skills.
Ok to proceed?" which hangs in scripts and CI.
2026-03-10 16:50:04 -04:00
Developers Digest 50ca954490 make setup skills install globally with all skills by default 2026-03-10 16:34:05 -04:00
Developers Digest 906a0204f3 add --full-depth to skills install, -y defaults to browser auth and --all 2026-03-09 12:05:27 -04:00
Nicolas ad0970df1d Nick: formatting 2026-03-06 18:56:54 -08:00
Nicolas 9befd6029a Nick: more workflows + interactive live view 2026-03-06 18:56:11 -08:00
Developers Digest b51cb3f250 fix init --all going interactive instead of skipping prompts
--all implies --yes per the help text, but handleInitCommand only
checked options.yes to enter non-interactive mode. Now it checks
options.all too.
2026-03-06 21:04:58 -05:00
Developers Digest 9a4b31e443 shop workflow: browser-first with live view and site preference 2026-03-06 20:54:57 -05:00
Developers Digest 84e308ea70 Stub OpenCode backend; add sites input to shop
Replace OpenCode backend implementation with a coming-soon stub: update displayName to "OpenCode (coming soon)" and make buildArgs print a message and exit to prevent use. In the shop workflow, add a new "sites" input (collected and returned), include it in the constructed user message, tweak prompt wording for context, add an instruction to work sequentially, and generalize the buy phase (remove hard dependency on the amazon profile). Minor UX and wording refinements included.
2026-03-06 20:41:12 -05:00
Developers Digest eb260d79a8 Add live-view browser launch and swap tools block
Add explicit guidance to launch a browser session with Live View before performing browser operations (run `firecrawl browser launch-session --json` and surface the Live View URL immediately). Insert this instruction into the experimental shared prompts and the passthrough system prompt. Also update the shop workflow to use `QA_TOOLS_BLOCK` instead of `FIRECRAWL_TOOLS_BLOCK`.
2026-03-06 20:36:30 -05:00
Developers Digest f8613d89ae Bump SDK, update docs & fix live view URL
Upgrade @mendable/firecrawl-js to v4.15.3 and remove the local workspace override. Revise README examples to use the unified firecrawl CLI commands and expand workflow examples. Update browser launch handling to use .liveViewUrl (and adjust jq examples) instead of the previous interactiveLiveViewUrl fallback.
2026-03-06 20:29:23 -05:00
Developers Digest 120303e83c Pass integration='cli' to SDK calls; update tests & docs
Add an explicit integration: 'cli' flag to SDK call options across commands (agent, browser, crawl, map, scrape, search) so the backend knows the CLI origin. Update browser launch/quick-execute defaults to include integration and adjust scrape params typing. Update tests to assert the integration field. Persist API URL when only a custom --api-url is provided (no api-key) during login, and use global CLI options when handling login invocation. Bump package version to 1.9.4, add keywords and upgrade @mendable/firecrawl-js to 4.15.1, and add a "Testing Workflows Locally" section to README with examples for Claude, Codex, and OpenCode CLIs.
2026-03-06 20:25:17 -05:00
Ashot Nazaryan 1e6a118b31 fix login on self-hosted setup 2026-03-04 19:14:21 -08:00
Nicolas 52cedea9ef Nick: 2026-03-02 11:30:59 -08:00
Nicolas 71c336a618 Nick: 2026-03-02 10:03:33 -08:00
Developers Digest f2121bfe8c agent-workflow-poc 2026-03-01 12:06:40 -05:00
Developers Digest 687fd54d83 Retry browser quick-execute on expired session 2026-02-27 14:24:01 -05:00
Developers Digest 396fb5149e Replace write-mode with --no-save-changes 2026-02-26 16:10:20 -05:00
Developers Digest 5daaa83816 Rename persistentSession to profile 2026-02-26 15:11:05 -05:00