Skip to main content
Firecrawl is a web scraping API that turns any website into clean, structured data. Cargo’s native integration with Firecrawl allows you to scrape individual pages, crawl or map a website, or ask an agent to gather data from the web.

How to set up Firecrawl

You can use Firecrawl in two ways:
  1. Cargo credits – Use Firecrawl through Cargo’s managed integration
  2. Your own API key – Connect your Firecrawl account

Connection details

Get your API key from the Firecrawl dashboard.

Firecrawl actions

Scrape

Extract content from a single URL. Use cases
  • Page content extraction – Get clean text from any webpage
  • Product data – Scrape product information from e-commerce sites
  • News monitoring – Extract articles and updates
  • Research – Gather information from multiple sources
Configuration Credit cost: 0.05 credits per page

Crawl

Recursively crawl a website and extract content from multiple pages. Use cases
  • Site-wide extraction – Crawl documentation or knowledge bases
  • Competitive analysis – Extract content from competitor sites
  • Content aggregation – Gather content across multiple pages
  • Data collection – Build datasets from websites
Configuration Options
Use Include and Exclude patterns to focus your crawl on specific sections of a website.
Credit cost: 0.05 credits per page crawled

Map

List the URLs of a website without scraping their content. Use cases
  • Page discovery – Find the pages worth scraping before running Scrape on them
  • Targeted lookups – Locate a specific page (pricing, login, payment) with a search term
  • Site audits – Get an inventory of a website’s pages
Configuration
Map pairs well with Scrape: map a website, pick the relevant links, then scrape only those pages.
Credit cost: 0.05 credits per map

Agent

Search and browse the web from a prompt. URLs are optional. Use this when you don’t already know which page holds the answer, for example when mapping an account from its name. Use cases
  • Account mapping – Find the products, pages, and people that describe an account
  • Structured research – Ask a question and get the answer in a shape you define
  • Focused lookups – Point the agent at a few URLs and keep it on those pages
Configuration
The result is the data the agent found. Its fields follow the schema when you set one.
Credit cost: 0.05 credits per Firecrawl credit the agent uses. A run that stops at the cap is not charged.

Firecrawl data models

Create data models from crawled websites to power your workflows.

Crawl extractor

Crawl a website and create records from each page. Configuration