43 lines
979 B
Markdown
43 lines
979 B
Markdown
---
|
||
name: firecrawl
|
||
description: "通过Firecrawl API进行网络搜索和抓取。在需要搜索网页、抓取网站(包括JS重型页面)、爬取整个站点或从网页提取结构化数据时使用。需要FIRECRAWL_API_KEY环境变量。"
|
||
---
|
||
|
||
# Firecrawl
|
||
|
||
Web search and scraping via Firecrawl API.
|
||
|
||
## Prerequisites
|
||
|
||
Set `FIRECRAWL_API_KEY` in your environment or `.env` file:
|
||
```bash
|
||
export FIRECRAWL_API_KEY=fc-xxxxxxxxxx
|
||
```
|
||
|
||
## Quick Start
|
||
|
||
### Search the web
|
||
```bash
|
||
firecrawl_search "your search query" --limit 10
|
||
```
|
||
|
||
### Scrape a single page
|
||
```bash
|
||
firecrawl_scrape "https://example.com"
|
||
```
|
||
|
||
### Crawl an entire site
|
||
```bash
|
||
firecrawl_crawl "https://example.com" --max-pages 50
|
||
```
|
||
|
||
## API Reference
|
||
|
||
See [references/api.md](references/api.md) for detailed API documentation and advanced options.
|
||
|
||
## Scripts
|
||
|
||
- `scripts/search.py` - Search the web with Firecrawl
|
||
- `scripts/scrape.py` - Scrape a single URL
|
||
- `scripts/crawl.py` - Crawl an entire website
|