Web Scraping API Parameters

The URL of the page to scrape. Must be a valid absolute URI (e.g. https://example.com).

Type of proxy to use. Options: datacenter, residential. Required if you’re targeting geo-restricted or bot-protected content.

ISO 3166-1 alpha-2 country code for proxy location (e.g. US, DE, IN).

CSS selectors for field-level extraction. Example: { "title": "h1", "link": "a @href" }.

Structured AI rules for LLM-based extraction. Supports types: string, number, boolean, list, item.

Example:

{
    "company": { "description": "Company name", "type": "string" },
    "email": { "type": "string" },
    "founded": { "type": "number" },
    "isHiring": { "type": "boolean" }
}

To learn more, see LLM Extraction.

Capture a screenshot of the page.

Extract all email addresses found in the page content.

Extract all hyperlinks (<a href="...">) from the page.

Delay (in milliseconds) after page load before scraping. Max: 30000.

CSS selector to wait for before scraping begins.

Example: .product-listing

Block loading of images and stylesheets.

Block common ad scripts and tracking pixels.

Block any network requests containing these substrings or domains.

Example: ["googleanalytics", "doubleclick"]

Enable JavaScript rendering (required for SPAs or dynamic content).

List of JavaScript actions to run on the page (click, scroll, wait, evaluate, etc.).

Example:

[
    {
        "click": "#buttonId"
    },
    {
        "fill": [".text_input", "value"]
    }
]

To learn more, see Page Interactions.

Custom headers to include in the request. Example: { "User-Agent": "custom-agent" }.

To learn more, see Custom Headers and Cookies.

Response format(s). Options: html, text, markdown, json. Multiple formats allowed.