{"uid":"cap_STWgIxJS9n5pcb29ZZ2io","slug":"fastaf-web-scraper-631c4083","name":"FastAF Web Scraper","description":"Scrape a public webpage for AI agents: convert a web page URL into markdown, HTML, links or images, with optional JavaScript rendering and AI extraction or summary. Supports web content retrieval for research and RAG; response format follows the requested options. Provided by Scrape a public webpage. Price: $0.005000 USDC per successful call.","url":"https://api.fastaf.co/x402/v1/scrape?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","title":"Scrape a public webpage","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","examples":[{"url":"https://example.com/","formats":"markdown"}],"required":["url"],"properties":{"url":{"type":"string","format":"uri","pattern":"^https?://","examples":["https://example.com/"],"description":"Required public HTTP(S) page URL. Zillow/eBay URLs are rejected without charge: use their dedicated endpoints. Booking defaults to rendering; Reddit uses a best-effort public feed (1 credit), ignoring rendering/proxy/wait/session/header options. Normal base cost: 1 credit; rendered Booking defaults cost 5. Other selected modes/AI can increase cost."},"type":{"enum":["image","pdf","pbf"],"type":"string","description":"Non-HTML target format: image, pdf or pbf (Protocolbuffer Binary Format). Omit for normal page scraping. This selects a binary resource, not a screenshot or an output format conversion. No additional credits; selected rendering/proxy/AI options determine the request cost."},"wait":{"type":"integer","maximum":35000,"minimum":0,"description":"Extra browser loading delay in milliseconds, integer 0-35000, for dynamic rendering. Omitted: no explicit extra delay, except rendered booking.com defaults to 8000. Does not enable rendering; ignored for Reddit feeds. No additional credits; selected rendering/proxy/AI options determine the request cost."},"image":{"type":"boolean","description":"Enable fetching image URLs; true/false, default false. Not a screenshot: use /screenshot for captures, or formats=images to extract page image links. No additional credits; selected rendering/proxy/AI options determine the request cost."},"country":{"type":"string","maxLength":8192,"description":"Proxy exit country as a two-letter ISO 3166-1 code, e.g. us, gb or de. Omit for no country targeting. Selecting any country uses premium-tier pricing even if premium=false; incompatible with challenge_mode. Ignored for Reddit feeds. Base cost with premium=true or any country: 10 credits, 25 with dynamic; AI adds 10."},"dynamic":{"type":"boolean","description":"Render JavaScript before extracting content; true/false. FastAF default false, except booking.com defaults true with wait=8000. Ignored for Reddit feeds. Base cost: 1 credit without rendering, 5 with rendering, or 25 with rendering plus premium/country; AI adds 10."},"formats":{"enum":["html","links","markdown","summary","images"],"type":"string","examples":["markdown"],"description":"One output format: html (default), links, markdown, summary or images. summary is AI-generated; links/images extract page URLs. Reddit supports html/markdown only. AI extraction (ai_query, ai_extract_rules or formats=summary) adds 10 credits once per request, even when combined; other formats add none."},"premium":{"type":"boolean","description":"Use residential proxies; true/false, default false. Cannot combine true with challenge_mode. Ignored for Reddit feeds. Base cost with premium=true or any country: 10 credits, 25 with dynamic; AI adds 10."},"ai_query":{"type":"string","maxLength":8192,"description":"Natural-language extraction prompt, e.g. Return the product price and currency. Omit for no prompt-based extraction. Not supported for Reddit feeds. AI extraction (ai_query, ai_extract_rules or formats=summary) adds 10 credits once per request, even when combined; other formats add none."},"js_rendering":{"type":"boolean","description":"Alias for dynamic with identical defaults and pricing. Boolean; cannot disagree with dynamic. Ignored for Reddit feeds. Base cost: 1 credit without rendering, 5 with rendering, or 25 with rendering plus premium/country; AI adds 10."},"challenge_mode":{"type":"boolean","description":"Browser-verification handling mode; true/false, default false. Uses its own rendering/proxies; cannot combine with dynamic=true, premium=true or country. Ignored for Reddit feeds. When enabled: 10 base credits; AI adds 10."},"custom_headers":{"type":"boolean","description":"Boolean upstream header-forwarding flag, default false; NOT a header map. FastAF does not forward caller HTTP headers, cookies or Authorization to the target, so this cannot customize them. Ignored for Reddit feeds. No additional credits; selected rendering/proxy/AI options determine the request cost."},"session_number":{"type":"string","maxLength":8192,"description":"Reusable proxy session identifier, e.g. 12345. Repeat it to request the same proxy IP; expires after 60 seconds of inactivity. Omit to rotate normally. Ignored for Reddit feeds; not a FastAF login session. No additional credits; selected rendering/proxy/AI options determine the request cost."},"ai_extract_rules":{"type":"string","maxLength":8192,"description":"JSON-encoded extraction instructions as a STRING, e.g. {\"price\":\"product price\",\"currency\":\"currency code\"}; not a nested JSON object. Omit for no rule-based extraction. Not supported for Reddit feeds. AI extraction (ai_query, ai_extract_rules or formats=summary) adds 10 credits once per request, even when combined; other formats add none."}},"description":"Web page retrieval by URL with formats=markdown; dynamic and other optional rendering or extraction parameters select different modes.","additionalProperties":false}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"string","description":"Markdown response text for formats=markdown, not a JSON wrapper. HTML is the default; links/images formats return JSON and binary targets return bytes."}}},"docsUrl":{"type":"string","format":"uri"},"website":{"type":"string","format":"uri"},"homepage":{"type":"string","format":"uri"},"openApiUrl":{"type":"string","format":"uri"}},"description":"Scrape a public webpage for AI agents: convert a web page URL into markdown, HTML, links or images, with optional JavaScript rendering and AI extraction or summary. Supports web content retrieval for research and RAG; response format follows the requested options.","x-tool-slug":"scrape_webpage"},"responseSchema":{"type":"text","format":"text/markdown","example":"# Example Domain\n\nThis domain is for use in documentation examples."},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.005","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.005/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_VWJlvqQYATWEewViE18pK","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.005","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches any public web page and returns its raw HTML or Markdown content, with optional JavaScript rendering, residential proxies, and bot-challenge bypass","exampleAgentPrompt":"Can you fetch the full page content from https://example.com/article as markdown, rendering the JavaScript and using a residential proxy to avoid blocks?","exampleUseCases":[{"title":"Monitor competitor pricing page","prompt":"Grab the HTML from https://competitor.com/pricing and convert it to markdown so I can see what their current plans and prices are."},{"title":"Scrape gated news article","prompt":"Fetch https://techcrunch.com/2024/05/01/some-article for me using JavaScript rendering and challenge bypass mode so I can read the full article content."},{"title":"Geo-targeted content retrieval","prompt":"Pull the page at https://example.co.uk/deals as markdown using a UK residential proxy so I get the British version of their offers."}],"resultDescription":"Returns the page content as raw HTML by default, or as Markdown when formats=markdown is specified. The response is the rendered or static page body as text. Failed, empty, incomplete, or verification-blocked pages are never returned or charged.","failureModes":["URL is not a valid public HTTP/HTTPS address — request rejected","Zillow or eBay URLs are rejected without charge (use dedicated endpoints)","Page returns empty or incomplete content — request not settled","Page presents verification/CAPTCHA that cannot be bypassed even with challenge_mode — not settled","Rendering timeout exceeded for dynamic pages","Invalid country code provided for geo-targeting","Requested URL is behind authentication that cannot be bypassed"],"whenToPreferThis":"Use this endpoint when you need the raw HTML or Markdown content of any arbitrary public web page, especially when the page requires JavaScript rendering, residential proxy access, or bot-challenge bypass. Prefer this over dedicated endpoints for general-purpose page scraping. Use the dedicated FastAF endpoints for Amazon, Google Maps, LinkedIn, Zillow, eBay, Walmart, or X (Twitter) structured data instead.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-29T00:33:14.741Z","isFirstParty":false,"canonicalSlug":"fastaf-web-scraper-631c4083"}