{"uid":"cap_orAry1UpEB3pRNUymkfqj","slug":"webextract-web-page-to-markdown-structured-json-api-bad9e6f5","name":"WebExtract Web Page to Markdown + Structured JSON API","description":"Fetch a public web page (robots.txt respected) and return cleaned Markdown plus fixed-schema JSON: article metadata, product/price, and tables with row/column checks.","url":"https://api.webextract.dev/v1/extract?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","required":["url"],"properties":{"url":{"type":"string","description":"Public http(s) URL to extract"}}}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object","required":["url","final_url","fetched_at","schema_version","markdown","metadata","product","tables"],"properties":{"url":{"type":"string"},"tables":{"type":"array","items":{"type":"object","properties":{"rows":{"type":"array","items":{"type":"array","items":{"type":"string"}}},"index":{"type":"integer"},"checks":{"type":"object","properties":{"row_count":{"type":"integer"},"column_count":{"type":"integer"},"consistent_width":{"type":"boolean"}}},"caption":{"type":["string","null"]},"headers":{"type":"array","items":{"type":"string"}}}}},"product":{"type":["object","null"],"properties":{"sku":{"type":["string","null"]},"gtin":{"type":["string","null"]},"name":{"type":["string","null"]},"brand":{"type":["string","null"]},"image":{"type":["string","null"]},"price":{"type":["number","null"]},"rating":{"type":["object","null"]},"source":{"type":["string","null"]},"currency":{"type":["string","null"]},"price_high":{"type":["number","null"]},"description":{"type":["string","null"]},"availability":{"type":["string","null"]}}},"markdown":{"type":"string"},"metadata":{"type":"object","properties":{"type":{"type":["string","null"]},"image":{"type":["string","null"]},"title":{"type":["string","null"]},"authors":{"type":"array","items":{"type":"string"}},"language":{"type":["string","null"]},"site_name":{"type":["string","null"]},"description":{"type":["string","null"]},"modified_at":{"type":["string","null"]},"published_at":{"type":["string","null"]},"canonical_url":{"type":["string","null"]}}},"final_url":{"type":"string"},"fetched_at":{"type":"string"},"word_count":{"type":"integer"},"schema_version":{"type":"string"},"markdown_truncated":{"type":"boolean"}}}}}}},"responseSchema":{"type":"json","example":{"url":"https://example.com/product/123","tables":[{"rows":[["Weight","1.2 kg"]],"index":0,"checks":{"row_count":1,"column_count":2,"consistent_width":true},"caption":null,"headers":["Spec","Value"]}],"product":{"sku":"A-123","gtin":null,"name":"Example Product","brand":"Acme","image":null,"price":19.99,"rating":{"count":210,"value":4.5},"source":"json-ld","currency":"USD","price_high":null,"description":"…","availability":"InStock"},"markdown":"# Example Product\n\nDescription...","metadata":{"type":"product","image":null,"title":"Example Product","authors":[],"language":"en","site_name":"Example","description":"…","modified_at":null,"published_at":null,"canonical_url":"https://example.com/product/123"},"final_url":"https://example.com/product/123","fetched_at":"2026-10-20T12:00:00.000Z","word_count":120,"schema_version":"1.0","markdown_truncated":false}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.005","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.005/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_N5_TAzfibweKa6aSn9GvA","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.005","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches a public web page and returns cleaned Markdown plus fixed-schema JSON containing article metadata, product/price details, and tables with structural checks.","exampleAgentPrompt":"Can you grab the page at https://www.example.com/product/blue-widget and pull out its price, availability, product name, and any tables — plus a clean Markdown version of the content?","exampleUseCases":[{"title":"Price monitoring for e-commerce product","prompt":"Fetch the page at https://www.bestbuy.com/product/sony-headphones-xm5 and extract the product name, current price, currency, and whether it's in stock."},{"title":"Article metadata extraction for content pipeline","prompt":"Pull the article at https://techcrunch.com/2024/05/01/openai-raises-funding and give me the title, authors, published date, and a clean Markdown version of the body text."},{"title":"Table extraction from a data-rich webpage","prompt":"Go to https://en.wikipedia.org/wiki/List_of_countries_by_GDP and extract all the tables with their headers and row data so I can analyze the numbers."}],"resultDescription":"A JSON object containing: the final resolved URL, fetch timestamp, schema version, full Markdown rendering of the page content, article metadata (title, description, authors, language, published/modified dates, site name, content type), product/price object (name, brand, SKU, GTIN, price, currency, price range, availability, rating, description, image), and an array of tables (headers, rows, caption, row/column count, consistency checks), plus word count and a truncation flag.","failureModes":["URL is blocked by robots.txt — returns an error indicating the page cannot be fetched","URL is not publicly accessible (requires login or paywall) — may return empty or partial content","Malformed or non-HTTP/HTTPS URL — validation error on the url parameter","Page returns non-200 status (404, 500, etc.) — upstream HTTP error surfaced","Product or metadata fields are null when page does not contain structured data (e.g. no JSON-LD)","Tables array is empty if page contains no tabular content","Markdown may be truncated for very large pages (indicated by markdown_truncated: true)"],"whenToPreferThis":"Choose this endpoint when you need both a human-readable Markdown rendering and structured JSON extraction (product, metadata, tables) from a single web page in one call. It is ideal for e-commerce price/availability checks, article ingestion pipelines, and table extraction tasks where consistent output schema is required. Prefer it over generic scraping tools when you need fixed-schema JSON with built-in structural validation (row/column checks) and robots.txt compliance out of the box.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-31T06:38:14.156Z","isFirstParty":false,"canonicalSlug":"webextract-web-page-to-markdown-structured-json-api-bad9e6f5"}