Wait For

Use the waitFor parameter to delay scraping until a specific HTML element appears on the page.

This is useful when the target content is rendered dynamically with JavaScript — for example, when you need to wait for product details, prices, or reviews to load after initial page render.

​

How It Works

• waitFor takes a CSS selector as its value (e.g. .product-title, #main, div[data-loaded=true])
• Scraping will begin only after the element is detected in the DOM
• If the element does not appear the request will fail

​

When to Use

• The page loads blank or incomplete without JS rendering
• You need to wait for a modal, tab, or dynamically loaded section to appear
• You want to avoid capturing partial content due to async loading delays

​

Example Request

curl --request POST \
  --url 'https://api.hasdata.com/scrape/web' \
  --header 'Content-Type: application/json' \
  --header 'x-api-key: <your-api-key>' \
  --data '{
    "url": "https://example.com/product/123",
    "waitFor": ".product-details",
    "jsRendering": true,
    "outputFormat": ["html"]
  }'

In this case, scraping will start only after .product-details is present on the page.

​

Notes

• This feature requires "jsRendering": true
• Combine with wait (time delay in ms) for extra control if needed
• If the selector never appears, you’ll receive a 400 response with an appropriate error