Files

979 B
Raw Permalink Blame History

name, description
name description
firecrawl 通过Firecrawl API进行网络搜索和抓取。在需要搜索网页、抓取网站包括JS重型页面、爬取整个站点或从网页提取结构化数据时使用。需要FIRECRAWL_API_KEY环境变量。

Firecrawl

Web search and scraping via Firecrawl API.

Prerequisites

Set FIRECRAWL_API_KEY in your environment or .env file:

export FIRECRAWL_API_KEY=fc-xxxxxxxxxx

Quick Start

Search the web

firecrawl_search "your search query" --limit 10

Scrape a single page

firecrawl_scrape "https://example.com"

Crawl an entire site

firecrawl_crawl "https://example.com" --max-pages 50

API Reference

See references/api.md for detailed API documentation and advanced options.

Scripts

  • scripts/search.py - Search the web with Firecrawl
  • scripts/scrape.py - Scrape a single URL
  • scripts/crawl.py - Crawl an entire website