Crawl

Firecrawl

Read a bounded set of pages from one public website.

Capability: Website crawling
Current price: $0.0070/page
Availability: Ready to run

What this API does

Follow links on one public website and extract up to 50 pages as Markdown, HTML or links. Reserves the selected page limit, then charges for completed pages and releases unused funds. Runs in the background and resumes the same crawl after a worker restart. Reports partial coverage and truncation. External links, subdomains, PDF parsing, X/Twitter and paid extraction options are excluded; robots.txt is respected. Each text format is capped at 100,000 characters per page.

Agents select this operation with tool ID firecrawl.crawl, then inspect its current executable contract before a run.

Public input and output shape

Input

formatsarray · optional

Value supplied for formats.

minItems: 1 · maxItems: 4

limitinteger · optional

Value supplied for limit.

minimum: 1 · maximum: 50

maxDiscoveryDepthinteger · optional

Value supplied for max discovery depth.

minimum: 0 · maximum: 5

onlyMainContentboolean · optional

Value supplied for only main content.

urlstring · required

Public HTTPS web page. PDF files and X/Twitter URLs are excluded.

format: uri · maxLength: 2048

Output

attempted_pagesnumber

Returned attempted pages value.

completed_pagesnumber

Returned completed pages value.

failed_pagesnumber

Returned failed pages value.

limitnumber

Returned limit value.

pagesarray

Returned pages value.

partialboolean

Returned partial value.

Example request and output

This reviewed worked example is shared with inspect. Inspect also returns the current executable schema and price estimate before a paid run.

Request

{
  "tool_id": "firecrawl.crawl",
  "input": {
    "url": "https://example.com/",
    "limit": 1,
    "formats": [
      "markdown"
    ],
    "maxDiscoveryDepth": 1
  }
}

Output

{
  "limit": 1,
  "pages": [
    {
      "url": "https://example.com/",
      "title": "Example Domain",
      "status": 200,
      "markdown": "# Example Domain\n\nThis domain is for use in documentation examples without needing permission. Avoid use in operations.\n\n[Learn more](https://iana.org/domains/example)",
      "truncated": false
    }
  ],
  "partial": false,
  "failed_pages": 0,
  "attempted_pages": 1,
  "completed_pages": 1
}

Teaching errors and limitations

invalid_input: The URL, query or limits are outside this tool's supported inputs.example: {"url":"https://example.com/","limit":1,"maxDiscoveryDepth":1,"formats":["markdown"]}
upstream_error: The provider could not return usable results; the wallet was not charged.Check the target page and retry with a smaller limit if necessary.

Use Crawl with Scrollport

Use Scrollport

Scrollport identifies and validates the best-in-class API tools and provides them on a pay-as-you-go basis so you don't need to maintain a separate provider account, subscription or credits.

Give your agent the setup prompt to receive $1 in trial credit and start using the tools right away.