scrollport

Firecrawl Crawl

Read a bounded set of pages from a public website.

by FirecrawlReady to run$0.0025 per page · $0.25 per 100 pages

Example

You ask your agent

“Crawl books.toscrape.com and give me the text of its first three pages.”

You get

Title
All products | Books to Scrape - Sandbox
URL
https://books.toscrape.com/
Markdown
- [Home](https://books.toscrape.com/index.html) - All products # All products **1000** results - showing **1** to…
What your agent sends and gets back (JSON)

Your agent works out the exact inputs, such as IDs, dates and settings, from what you ask.

Request

{
  "tool_id": "firecrawl.site-crawl",
  "input": {
    "url": "https://books.toscrape.com/",
    "limit": 3,
    "formats": [
      "markdown"
    ],
    "onlyMainContent": true,
    "maxDiscoveryDepth": 1
  }
}

Response

{
  "limit": 3,
  "pages": [
    {
      "url": "https://books.toscrape.com/",
      "title": "\n    All products | Books to Scrape - Sandbox\n",
      "status": 200,
      "markdown": "- [Home](https://books.toscrape.com/index.html)\n- All products\n\n# All products\n\n**1000** results - showing **1** to **20**.\n\n\n\n\n\n\n**Warning!** This is a demo website for web scraping purposes. Prices and ratings here were randomly assigned and have no real meaning.\n\n01. [![A Light in the Attic](https://books.toscrape.com/media/cache/2c/da/2cdad67c44b002e7ead0cc35693c0e8b.jpg)](https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html)\n\n\n\n\n\n\n\n    ### [A Light in the ...](https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html \"A Light in the Attic\")\n\n\n\n\n\n    £51.77\n\n\n\n\n\n    In stock\n\n\n\n    Add to basket\n\n02. [![Tipping the Velvet](https://books.toscrape.com/m",
      "truncated": false
    }
  ],
  "partial": false,
  "failed_pages": 0,
  "attempted_pages": 3,
  "completed_pages": 3
}

Use it with your agent

Copy the prompt and paste it into your agent, then tell it what you need.

Read https://scrollport.com/start. Use my existing Scrollport connection, or help me connect if needed. Help me use Firecrawl Crawl (tool ID: firecrawl.site-crawl). Ask me for the details you need, then show me the result.

Provider access is included. If your agent isn't connected to Scrollport yet, it will help you set that up.

Other tools for this job

Compare all 2 →

Questions

Is Firecrawl Crawl free?

Scrollport has no free tier: it costs $0.0025 per page ($0.25 per 100 pages), paid per use from a prepaid wallet with no subscription. Connecting your first agent adds $1 of trial credit, so you can try it before adding funds.

Do I need an API key from Firecrawl?

No. Your agent runs it through your Scrollport connection (MCP, the Scrollport CLI or the HTTP API), and Scrollport handles access to Firecrawl, so you don't sign up with Firecrawl or manage an API key.

Details

About this tool

Read up to 50 pages from one public website, with bounded depth and Markdown, HTML or links. Reserve the requested page limit, then charge only for successfully delivered pages and release unused funds. Partial delivery reports completed and failed page counts. The same durable job resumes after interruption. Subdomains, PDF documents, X/Twitter and JSON extraction are excluded. The worked example shows selected fields and at most one item per list; counts retain their recorded values.

All inputs and outputs

Input

formatsarray · optional

Output formats to return.

minItems: 1 · maxItems: 4

limitinteger · optional

Maximum number of results to return.

minimum: 1 · maximum: 50

maxDiscoveryDepthinteger · optional

minimum: 0 · maximum: 5

onlyMainContentboolean · optional

Whether to return only the page's main content.

urlstring · required

Public HTTPS web page. PDF files and X/Twitter URLs are excluded.

format: uri · maxLength: 2048

Output

attempted_pagesnumber
completed_pagesnumber
failed_pagesnumber
limitnumber
pagesarray
partialboolean
Errors and limits
  • invalid_input: The URL, query or limits are outside this tool's supported inputs.example: {"url":"https://example.com/","limit":1,"maxDiscoveryDepth":1,"formats":["markdown"]}
  • upstream_error: The provider could not return usable results; the wallet was not charged.Check the target page and retry with a smaller limit if necessary.