Use this file to discover all available pages before exploring further.
The Web Scraping API lets you scrape any public web page without handling proxies, headless browsers, or captchas. You send a URL, and we return the raw page content and optionally parsed data.
{ "requestMetadata": { "id": "e29e8506-143b-4872-a079-53b72e0edb10", "status": "ok" }, "headers": { "accept-ranges":"bytes", "alt-svc":"h3=\":443\"; ma=93600,h3-29=\":443\"; ma=93600,quic=\":443\"; ma=93600; v=\"43\"", "cache-control":"max-age=2589", "content-encoding":"gzip", "content-length":"648", "content-type":"text/html", "date":"Fri, 11 Apr 2025 23:41:30 GMT", "etag":"\"84238dfc8092e5d9c0dac8ef93371a07:1736799080.121134\"", "last-modified":"Mon, 13 Jan 2025 20:11:20 GMT", "vary":"Accept-Encoding" }, "screenshot": "https://f005.backblazeb2.com/file/hasdata-screenshots/e29e8506-143b-4872-a079-53b72e0edb10.jpeg", "content": "<!DOCTYPE html><html><head><title>Example Domain</title> ... </body></html>", "markdown": "# Example Domain\n\nThis domain is for use in ... [More information...](https://www.iana.org/domains/example)", "text": "Example Domain\n\nThis domain is for use in ... More information..."}
Maximum page load time is restricted to 300 seconds. In cases where a request fails after 300 seconds, you will not be charged for the unsuccessful request.