Commit Graph

543 Commits

Author SHA1 Message Date
Abimael Martell 5948945fd1 add agent docs 2026-02-03 16:39:47 -08:00
Abimael Martell 41927d7bd4 Implement agent command (#22)
* Add agent command for AI-powered web data extraction

Implement the agent endpoint that allows users to extract data from the web
using natural language prompts. Supports structured output via JSON schemas,
URL targeting, credit limits, and async job handling with polling.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Add --model option to agent command

Support selecting between fire-1 (default) and fire-1-mini (faster, cheaper)
models for agent extraction tasks.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Update firecrawl-js SDK to 4.12.0 with model support

- Upgrade @mendable/firecrawl-js from 4.10.0 to 4.12.0
- Update model types to match SDK: spark-1-mini and spark-1-pro

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Add spinner animation for agent command

- Add spinner utility for CLI feedback
- Show animated spinner while agent is starting and processing
- Display success/fail indicators when complete
- Remove --progress flag (spinner now always shown)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Handle Ctrl+C gracefully in agent command

When user interrupts with Ctrl+C while waiting for agent completion,
show helpful message with the command to check job status later.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Allow --wait when checking agent job status

Now you can use `firecrawl agent <job-id> --wait` to continuously
poll an existing job until it completes, with the same spinner
animation and Ctrl+C handling.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Improve error handling in agent command

- Stop spinner before showing error messages
- Extract detailed error messages from API responses
- Show full error details to help debug issues

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Extract error details from Firecrawl SDK errors

Show helpful error messages like "Invalid option: expected one of
spark-1-pro|spark-1-mini" instead of just "Bad Request".

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Validate model option before API call

Show clear error message for invalid models instead of waiting
for API rejection.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* add agent to skill

* only command for now

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-02-03 16:36:14 -08:00
Developers Digest 009d6cda6a bump version 2026-02-03 13:59:44 -05:00
Developers Digest cd012d38c6 Add gitignore status checks 2026-02-03 13:52:33 -05:00
Developers Digest 37e2e6ae11 Merge pull request #21 from firecrawl/add-claude-plugin
add claude plugin
2026-01-30 18:06:05 -08:00
Developers Digest 0e71700b0d add claude plugin 2026-01-30 18:05:30 -08:00
Abimael Martell 5d17618ffa update repo on package.json 2026-01-30 17:31:50 -08:00
Abimael Martell 0d6c186cc0 update publish.yml 2026-01-30 17:27:33 -08:00
Abimael Martell c6ed7f3231 update publish.yml 2026-01-30 17:22:03 -08:00
Abimael Martell 789b457c76 update publish.yml 2026-01-30 17:20:43 -08:00
Abimael Martell e846e5cec4 update publish.yml 2026-01-30 17:16:25 -08:00
Abimael Martell ae4ec88d8a update npm version on publish workflow 2026-01-30 17:09:30 -08:00
Abimael Martell 518bc133b7 Bump version from 1.1.1 to 1.2.1 2026-01-30 16:52:57 -08:00
Abimael Martell a8d3d15edf test: Add test coverage for --api-url option
Add tests for apiUrl option in:
- parseScrapeOptions
- executeScrape
- executeCrawl
- executeMap
- executeSearch
- executeCreditUsage

All tests verify that apiUrl is correctly passed to getClient and
used in API calls.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-30 16:51:53 -08:00
Abimael Martell 8845a2fc08 Add support for local/custom API URLs (#20)
* Add support for local/custom API URLs

For custom API URLs (e.g., local development with Docker), the CLI now:
- Skips API key requirement when using non-cloud URLs
- Allows optional API key input during login
- Skips browser auth flow for custom URLs

This enables use with local Firecrawl instances that have
USE_DB_AUTHENTICATION=false.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Add --api-url option to commands

Add --api-url flag at both global and command levels (scrape, crawl,
map, search, credit-usage) similar to --api-key. When a custom API URL
is provided, authentication is skipped allowing requests to local or
self-hosted Firecrawl instances without an API key.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* docs: Add --api-url option documentation

Document the --api-url option for self-hosted and local development
use cases in the README, including examples for environment variables
and CI/CD usage.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* docs: Add --api-url to login and config examples

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-30 16:48:27 -08:00
Abimael Martell 96d0786b4f Fix job ID detection to support UUID v7 (#19)
Firecrawl returns UUID v7 job IDs, but the regex only matched UUID v4.
This caused `firecrawl crawl <job-id>` to fail with a URL validation error
instead of checking job status.

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-30 16:26:16 -08:00
Jimmy Stridh 8db0ec6f19 docs(skill): add URL quoting reminder (#13)
Co-authored-by: Jimmy Stridh <jimmystridh@users.noreply.github.com>
2026-01-30 16:21:33 -08:00
Abimael Martell 1ded7e23e4 Remove extra blank lines in README.md (#18)
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-30 16:16:27 -08:00
Nicolas c39c867192 Merge pull request #12 from firecrawl/fix/shorter-description
Update SKILL.md
2026-01-27 11:55:26 -08:00
Leonardo Grigorio 09385e7289 Update SKILL.md 2026-01-27 11:48:50 -08:00
Nicolas 463b7a1a88 Update README.md 2026-01-26 17:23:04 -08:00
Nicolas f5f8d3addd Update SKILL.md 2026-01-25 14:12:58 -08:00
Nicolas bd6ede2a01 Nick: --browser 2026-01-24 17:04:41 -08:00
Nicolas f33dcd2f27 Update SKILL.md 2026-01-24 16:46:49 -08:00
Nicolas fd08f29f43 Nick: 2026-01-24 16:43:55 -08:00
Nicolas 4146359fed Update SKILL.md 2026-01-24 16:28:08 -08:00
Nicolas aee27efe43 Update SKILL.md 2026-01-24 16:25:38 -08:00
Nicolas 463a58b396 Update SKILL.md 2026-01-24 16:24:16 -08:00
Nicolas 96bbae7a00 Update SKILL.md 2026-01-24 16:21:45 -08:00
Developers Digest b5032a0721 Merge pull request #11 from firecrawl/skill-updates
Update Firecrawl CLI examples to include --json flag
2026-01-23 12:35:20 -05:00
Developers Digest ecada6d233 improve parallelization 2026-01-23 09:47:08 -05:00
Developers Digest a7adc4e53f instruct to run requests in parralel + add in a scratch pad for onetime scripts in .firecrawl folder 2026-01-23 08:48:24 -05:00
Developers Digest 8584f6ced8 Update concurrency label to 'parallel scrape limit'
Replaces 'parallel scrape/crawl limit' with 'parallel scrape limit' in status output, README, and SKILL.md for clarity and consistency.
2026-01-23 08:21:30 -05:00
Developers Digest 45b63b2b02 Add --status command to display CLI and account info
Introduces a new --status flag to the CLI, showing version, authentication status, concurrency limits, and credit usage. Updates documentation and skill instructions to reflect the new command. Increments package version to 1.1.0.
2026-01-23 08:12:23 -05:00
Developers Digest 48cf709a63 Improve Firecrawl CLI skill description frontmatter 2026-01-22 15:26:28 -05:00
Developers Digest a0c070a726 Update Firecrawl CLI examples to include --json flag 2026-01-22 14:22:34 -05:00
Nicolas dc2120cf77 Update README.md 2026-01-22 14:14:32 -03:00
Nicolas d119e408d3 Update README.md 2026-01-22 14:13:35 -03:00
Nicolas 2925e4bc74 Update auth.ts 2026-01-22 13:29:42 -03:00
Nicolas 4279839428 Update auth.ts 2026-01-22 12:42:24 -03:00
Nicolas e8cc94b24d Nick: 2026-01-22 12:34:58 -03:00
Nicolas 4e906c40b6 Nick: 2026-01-22 12:24:05 -03:00
Nicolas 17d72eb7ad Update SKILL.md 2026-01-22 12:02:44 -03:00
Nicolas db3114184d Update SKILL.md 2026-01-22 12:00:47 -03:00
Nicolas 4fefc42faa Nick: 2026-01-22 11:51:08 -03:00
Nicolas adaf03a27a Nick: 2026-01-22 11:43:54 -03:00
Nicolas 4b09c324d8 Create install.md 2026-01-22 11:41:43 -03:00
Nicolas 8a847caa5b Merge pull request #10 from firecrawl/update-agent-auth-flow
Update agent auth flow
2026-01-22 11:35:53 -03:00
Developers Digest e856cb7d38 update 2026-01-21 19:20:39 -05:00
Developers Digest b41caff94a update SKILL.md with browser authentication instructions 2026-01-21 17:03:54 -05:00