{"uid":"cap_d8WOYLNg40gBSsMIjNHJu","slug":"agdata-web-unblocker-url-to-markdown-html-text-b8425687","name":"agdata Web Unblocker — URL to Markdown/HTML/Text","description":"Unblocking and fresh web data for AI agents. Social, maps, search, news, jobs and reviews as structured data, and unblocking for any other page, as Markdown or HTML. Pay per call in stablecoins over x402 or MPP, with no API key, no account and no proxy setup. (x402 on Base and Polygon (plus Solana on most routes) or MPP on Base)","url":"https://agdata.shveik.dev/mpp/unblock?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"url":{"type":"string","maxLength":2048},"format":{"enum":["markdown","html","text"],"type":"string"}}},"responseSchema":{"type":"json","example":{"url":"https://…","title":"Example…","format":"markdown","jsonLd":null,"content":"This dom…","finalUrl":"https://…","language":"en","fetchedAt":"2026-10-…","truncated":false,"statusCode":200,"contentType":"text/htm…","description":null,"canonicalUrl":"https://…","contentBytes":156}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01955","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01955/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01955","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01955","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_UuNRi_9J0jmkQDAwOAXmz","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01955","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches any URL, bypassing Cloudflare and bot protection, renders JavaScript, and returns clean Markdown, HTML, or plain text content","exampleAgentPrompt":"Grab the content from https://example.com/article and give it to me as clean markdown — it's behind Cloudflare so you'll need something that can get past bot protection.","exampleUseCases":[{"title":"Extract article from Cloudflare-protected site","prompt":"Can you fetch the full text of this article for me: https://www.someprotectedsite.com/article/2024/best-practices — it keeps blocking normal requests. Return it as markdown."},{"title":"Scrape JavaScript-rendered product page","prompt":"Go grab the content from https://shop.example.com/products/widget-pro — it loads everything with JavaScript so normal fetchers won't see anything. I need the HTML back."},{"title":"Monitor competitor landing page content","prompt":"Fetch https://competitor.com/landing and return it as plain text so I can compare what they're saying against last week's version."}],"resultDescription":"A JSON object containing the page URL, title, requested format content (markdown/HTML/text), final redirected URL, detected language, JSON-LD structured data, fetch timestamp, truncation flag, HTTP status code, content type, meta description, canonical URL, and content size in bytes. If the page cannot be fetched, the call is not charged.","failureModes":["Page is completely inaccessible even after bot bypass attempts — returns an error and no charge is applied","URL is malformed or exceeds 2048 characters — request rejected with validation error","Target site uses advanced anti-bot measures beyond Cloudflare that cannot be bypassed — fetch fails","JavaScript rendering timeout on very slow or complex SPAs — may return incomplete content","Content truncated for very large pages — truncated field will be true in response"],"whenToPreferThis":"Choose this endpoint when you need to fetch content from URLs that actively block bots, use Cloudflare protection, or require JavaScript rendering to display content. It is especially valuable over standard HTTP fetch utilities when targeting news sites, e-commerce pages, or any modern SPA. The pay-per-successful-call model (no charge on failure) makes it cost-efficient for exploratory scraping. Prefer this over headless browser setups when you need a simple API call without infrastructure overhead.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-14T12:40:48.146Z","isFirstParty":false,"canonicalSlug":"agdata-web-unblocker-url-to-markdown-html-text-b8425687"}