{"uid":"cap_0-dURQPVXxEcZTZgiprLu","slug":"vaaya-ai-crw-scrape-single-url-web-scraper-d117dc65","name":"vaaya.ai CRW Scrape — Single URL Web Scraper","description":"CRW — Scrape a single URL to clean markdown/HTML/JSON (Firecrawl-compatible). Pass `url`; optional `formats` (markdown|html|rawHtml|plainText|links|json|summary|screenshot, default markdown), `onlyMainContent` (default true), `renderJs` (null = auto-detect), `waitFor` (ms), `stealth` (anti-bot browser), `country` (2-letter proxy egress), `jsonSchema` (structured output). Sync — returns the scraped content directly. Cheapest full-featured scrape rung.","url":"https://vaaya.ai/api/run/crw/scrape?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method","bodyType","body"],"properties":{"body":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","required":["url"],"properties":{"url":{"type":"string","format":"uri"},"country":{"type":"string","maxLength":2,"minLength":2},"formats":{"type":"array","items":{"type":"string"}},"stealth":{"type":"boolean"},"waitFor":{"type":"integer","minimum":0},"renderJs":{"type":["boolean","null"]},"jsonSchema":{"type":"object","additionalProperties":{}},"onlyMainContent":{"type":"boolean"}},"additionalProperties":true},"type":{"type":"string","const":"http"},"method":{"enum":["POST"],"type":"string"},"bodyType":{"enum":["json","form-data","text"],"type":"string"},"pathParams":{"type":"object"}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"registry","requiresHandshake":false,"reviewCount":1,"rating":{"score":"0.42","successRate":"1.00","reviews":1,"stars":"2.7","state":"rated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_wPbN3oMG-H0DDmTPqOxV0","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":null,"unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Scrapes a single URL and returns clean markdown, HTML, JSON, plain text, links, or screenshot content synchronously","exampleAgentPrompt":"Scrape https://techcrunch.com/2024/01/15/openai-funding and give me the main article content as clean markdown, ignoring nav and footer boilerplate.","exampleUseCases":[{"title":"Extract article content for research","prompt":"Scrape https://www.wired.com/story/ai-agents-future-work and return just the main article text as markdown — skip the navigation, ads, and sidebars."},{"title":"Structured product data extraction","prompt":"Fetch https://store.apple.com/us/product/MQLD3LL/A and extract the product name, price, and key specs as structured JSON using a schema I'll define."},{"title":"Screenshot paywalled page via proxy","prompt":"Grab a screenshot of https://www.nytimes.com/2024/06/01/technology/ai-regulation.html using a UK proxy and stealth mode to get past the bot detection."}],"resultDescription":"Returns the scraped content of the requested URL in the specified format(s): clean markdown (default), raw or processed HTML, plain text, a list of links, structured JSON matching a provided schema, a page summary, or a screenshot URL. The response is synchronous and delivered directly.","failureModes":["URL unreachable or returns non-200 status — returns error with HTTP status code","Anti-bot / CAPTCHA blocking without stealth mode — returns empty or blocked content","JavaScript-heavy page not fully rendered — use renderJs=true or increase waitFor ms","Invalid or unsupported URL format — returns validation error","Requested JSON schema does not match page structure — returns empty or partial JSON","Country code proxy unavailable — returns error or falls back","Timeout on slow pages — increase waitFor parameter"],"whenToPreferThis":"Choose this endpoint when you need to scrape a single URL synchronously and want the result immediately without managing a crawl job. It is the cheapest full-featured scraping option on vaaya.ai and supports Firecrawl-compatible options including stealth mode, JS rendering, structured JSON extraction, country-based proxying, and multiple output formats. Prefer it over the async crawl endpoint for single-page extraction tasks where you don't need to follow links.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":1,"lastUsedAt":"2026-08-13T16:46:12.250Z","lastSuccessfullyRanAt":"2026-08-13T16:46:12.250Z","lastHealthCheckAt":"2026-10-01T18:53:48.066Z","isFirstParty":false,"canonicalSlug":"vaaya-ai-crw-scrape-single-url-web-scraper-d117dc65"}