Skip to Content

Scrape List

Turn a list of urls into clean scraped data.

Billable OperationProviderBilling Mode
Docs
Connection
Docs
Cost per operation
Docs
firecrawl-list-url-scrape
P
Firecrawl
On Success
Managed, User

0.10 credits

Input Fields

json
urls

Output Fields

json
scrape_list_response
  Enabled by default

const options = {
  method: 'POST',
  headers: {'content-type': 'application/json', authorization: 'Bearer <TOKEN>'},
  body: JSON.stringify({
    config: {environment: 'production'},
    pipes: [
      {
        pipe_id: 'website:scrapelist:firecrawl@1',
        config: {scrape_main_only: true, formats: ['markdown', 'links']}
      }
    ],
    input: [
      {
        id: '1',
        urls: ['https://pipe0.com', 'https://pipe0.com/resources/documentation']
      }
    ]
  })
};

fetch('https://api.pipe0.com/v1/pipes/run', options)
  .then(res => res.json())
  .then(res => console.log(res))
  .catch(err => console.error(err));