{"uid":"cap_e0NJHeXV9AkiuQIxyFM76","slug":"minifetch-proxy-url-metadata-extractor-1d78ff92","name":"Minifetch Proxy URL Metadata Extractor","description":"For pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy & extract same rich structured metadata as /extract/url-metadata (headers, favicons, title, description, canonical, meta tags, OG, JSON-LD, etc). No JS render; use /proxy/render for that. Optional ?country= (2-letter code). Same ?fields= and ?omitEmpty= params. Not cached. Supports GET & POST","url":"https://minifetch.com/api/v1/x402/proxy/extract/url-metadata?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","required":["url"],"properties":{"url":{"type":"string","description":"The target URL from which to extract metadata."},"fields":{"type":"string","description":"Optional. Selection narrows response to only fields you need: comma-separated atomic field names (e.g. title, description), named groups (network, meta, og, twitter), and/or meta:tag-name for specific meta tag. Returns all fields when omitted; an unknown field returns 400."},"country":{"type":"string","description":"Optional. 2-letter ISO 3166-1 country code (ex: de, mx) to fetch from. Invalid code returns 400."},"omitEmpty":{"type":"boolean","description":"Optional. If true, drops empty fields (empty string, [], {}) from response."},"includeResponseBody":{"type":"boolean","description":"Optional. If true, includes full HTML response body as string in result."}}}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object","properties":{"results":{"type":"array","items":{"type":"object","properties":{"data":{"type":"object","properties":{"url":{"type":"string","description":"Final URL after redirects"},"lang":{"type":"string"},"image":{"type":"string"},"proxy":{"type":"object","properties":{"render":{"type":"boolean","description":"true if JS executed"},"country":{"type":["string","null"]},"provider":{"type":"string"},"proxyUrl":{"type":["string","null"]},"proxyType":{"type":"string","description":"Always \"managed\" on proxy routes"},"robotsTxt":{"type":"object","properties":{"allowed":{"type":["boolean","null"]}}},"userAgent":{"type":"string"}},"description":"Fetch provenance. External proxy routes do not check robots.txt"},"title":{"type":"string"},"author":{"type":"string"},"jsonld":{"type":"array","description":"Parsed JSON-LD blocks"},"og:url":{"type":"string","description":"Returns all og: tags, not just og:url"},"robots":{"type":"string"},"source":{"type":"string"},"charset":{"type":"string"},"creator":{"type":"string"},"imgTags":{"type":"array"},"favicons":{"type":"array","description":"Discovered icon entries"},"headings":{"type":"array"},"hreflang":{"type":"array","description":"hreflang and href"},"keywords":{"type":"string"},"referrer":{"type":"string"},"viewport":{"type":"string"},"canonical":{"type":"string"},"publisher":{"type":"string"},"requestUrl":{"type":"string","description":"URL as requested, before redirects"},"description":{"type":"string"},"twitter:url":{"type":"string","description":"Returns all twitter: tags, not just twitter:url"},"responseBody":{"type":"string","description":"Raw HTML; only when ?includeResponseBody=true"},"canonicalUrls":{"type":"array","items":{"type":"string"}},"product:brand":{"type":"string","description":"Returns all brand: tags, not just product:brand"},"minifetchCache":{"type":"object","properties":{"hit":{"type":"boolean"}},"description":"External proxy routes not cached: always { hit: false }"},"responseHeaders":{"type":"object","description":"Selected response headers"},"responseStatusCode":{"type":"integer"}},"description":"Default metadata: proxy & minifetchCache objects always returned, outside the ?fields= and ?omitEmpty= query param selections."}}}},"success":{"type":"boolean"},"queryParameters":{"type":"object"}}}}}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.003","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.003/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.003","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.003","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_Pd_kzdEzVfp-NwooNUrBI","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.003","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches a target URL through a rotating external proxy (bypassing bot-blocking) and extracts rich structured metadata including headers, favicons, title, description, canonical, meta tags, OG, JSON-LD, and more — without JavaScript rendering.","exampleAgentPrompt":"That competitor's product page at https://example.com/product keeps blocking my scraper — can you use a rotating proxy to pull all the metadata from it (title, description, OG tags, JSON-LD) and route the request through Germany?","exampleUseCases":[{"title":"Competitor page metadata extraction","prompt":"The site at https://competitor.com/pricing is blocking my normal requests with a 403. Can you route through a proxy and extract the full metadata — title, description, OG image, and any JSON-LD — from that page?"},{"title":"Geo-restricted content metadata fetch","prompt":"I need the Open Graph tags and canonical URL from https://news.example.co.uk/article/12345 but it only shows content to UK visitors — can you fetch the metadata routing through the UK?"},{"title":"Bot-blocked e-commerce product scraping","prompt":"Pull the structured metadata from https://shop.example.com/item/99 — they block crawlers so use a rotating proxy. I just need the title, description, og:image, and any JSON-LD product schema, and skip any empty fields in the response."}],"resultDescription":"Returns a structured JSON object with rich page metadata including: final URL after redirects, page title, meta description, canonical URL, language, OG tags, Twitter card tags, JSON-LD blobs, favicon URLs, HTTP response headers, and proxy provenance info (provider, country, robots.txt status). Optionally includes full HTML body. Empty fields can be omitted.","failureModes":["Invalid or unreachable URL returns an error","Invalid 2-letter country code returns HTTP 400","Unknown field name in ?fields= returns HTTP 400","Target page may still block even via proxy (no JS rendering — use /proxy/render for JS-heavy pages)","Response is not cached so repeated calls incur cost each time","Proxy provider may occasionally fail or timeout"],"whenToPreferThis":"Use this endpoint when the target URL actively blocks standard HTTP crawlers or the Minifetch native proxy, and you need rich structured metadata (OG, JSON-LD, meta tags, etc.) without JavaScript rendering. Prefer this over the standard /extract/url-metadata endpoint when you encounter 403s, Cloudflare challenges, or bot-detection blocks. If the page requires JavaScript execution to render meaningful content, use /proxy/render instead. Choose this over generic proxy services because it returns pre-parsed, structured metadata rather than raw HTML.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-14T06:30:22.640Z","isFirstParty":false,"canonicalSlug":"minifetch-proxy-url-metadata-extractor-1d78ff92"}