Tools
Firecrawl
Scrape, search, crawl, map, and extract web data
Integrate Firecrawl into the workflow. Scrape pages, search the web, crawl entire sites, map URL structures, and extract structured data with AI.
Extract structured content from web pages with comprehensive metadata support. Converts content to markdown or HTML while capturing SEO metadata, Open Graph tags, and page information.
| Parameter | Type | Required | Description |
|---|
url | string | Yes | The URL to scrape content from |
apiKey | string | Yes | Firecrawl API key |
| Parameter | Type | Description |
|---|
markdown | string | Page content in markdown format |
html | string | Raw HTML content of the page |
metadata | object | Page metadata including SEO and Open Graph information |
Search for information on the web using Firecrawl
| Parameter | Type | Required | Description |
|---|
query | string | Yes | The search query to use |
apiKey | string | Yes | Firecrawl API key |
| Parameter | Type | Description |
|---|
data | array | Search results data |
Crawl entire websites and extract structured content from all accessible pages
| Parameter | Type | Required | Description |
|---|
url | string | Yes | The website URL to crawl |
limit | number | No | Maximum number of pages to crawl (default: 100) |
onlyMainContent | boolean | No | Extract only main content from pages |
apiKey | string | Yes | Firecrawl API Key |
| Parameter | Type | Description |
|---|
pages | array | Array of crawled pages with their content and metadata |
total | number | Total number of pages found during crawl |
creditsUsed | number | Number of credits consumed by the crawl operation |
Get a complete list of URLs from any website quickly and reliably. Useful for discovering all pages on a site without crawling them.
| Parameter | Type | Required | Description |
|---|
url | string | Yes | The base URL to map and discover links from |
search | string | No | Filter results by relevance to a search term (e.g., "blog") |
sitemap | string | No | Controls sitemap usage: "skip", "include" (default), or "only" |
includeSubdomains | boolean | No | Whether to include URLs from subdomains (default: true) |
ignoreQueryParameters | boolean | No | Exclude URLs containing query strings (default: true) |
limit | number | No | Maximum number of links to return (max: 100,000, default: 5,000) |
timeout | number | No | Request timeout in milliseconds |
apiKey | string | Yes | Firecrawl API key |
| Parameter | Type | Description |
|---|
success | boolean | Whether the mapping operation was successful |
links | array | Array of discovered URLs from the website |
Extract structured data from entire webpages using natural language prompts and JSON schema. Powerful agentic feature for intelligent data extraction.
| Parameter | Type | Required | Description |
|---|
urls | json | Yes | Array of URLs to extract data from (supports glob format) |
prompt | string | No | Natural language guidance for the extraction process |
schema | json | No | JSON Schema defining the structure of data to extract |
enableWebSearch | boolean | No | Enable web search to find supplementary information (default: false) |
ignoreSitemap | boolean | No | Ignore sitemap.xml files during scanning (default: false) |
includeSubdomains | boolean | No | Extend scanning to subdomains (default: true) |
showSources | boolean | No | Return data sources in the response (default: false) |
ignoreInvalidURLs | boolean | No | Skip invalid URLs in the array (default: true) |
apiKey | string | Yes | Firecrawl API key |
| Parameter | Type | Description |
|---|
success | boolean | Whether the extraction operation was successful |
data | object | Extracted structured data according to the schema or prompt |
- Category:
tools
- Type:
firecrawl
