43 lines
979 B
Markdown
43 lines
979 B
Markdown
|
---
|
|||
|
|
name: firecrawl
|
|||
|
|
description: "通过Firecrawl API进行网络搜索和抓取。在需要搜索网页、抓取网站（包括JS重型页面）、爬取整个站点或从网页提取结构化数据时使用。需要FIRECRAWL_API_KEY环境变量。"
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Firecrawl
|
|||
|
|
|
|||
|
|
Web search and scraping via Firecrawl API.
|
|||
|
|
|
|||
|
|
## Prerequisites
|
|||
|
|
|
|||
|
|
Set `FIRECRAWL_API_KEY` in your environment or `.env` file:
|
|||
|
|
```bash
|
|||
|
|
export FIRECRAWL_API_KEY=fc-xxxxxxxxxx
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
## Quick Start
|
|||
|
|
|
|||
|
|
### Search the web
|
|||
|
|
```bash
|
|||
|
|
firecrawl_search "your search query" --limit 10
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
### Scrape a single page
|
|||
|
|
```bash
|
|||
|
|
firecrawl_scrape "https://example.com"
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
### Crawl an entire site
|
|||
|
|
```bash
|
|||
|
|
firecrawl_crawl "https://example.com" --max-pages 50
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
## API Reference
|
|||
|
|
|
|||
|
|
See [references/api.md](references/api.md) for detailed API documentation and advanced options.
|
|||
|
|
|
|||
|
|
## Scripts
|
|||
|
|
|
|||
|
|
- `scripts/search.py` - Search the web with Firecrawl
|
|||
|
|
- `scripts/scrape.py` - Scrape a single URL
|
|||
|
|
- `scripts/crawl.py` - Crawl an entire website
|