{"uid":"cap_J5XN33PKGf34S8qksW6Ij","slug":"scrapemole-reader-xml-sitemap-fetcher-7a48a21c","name":"ScrapeMole Reader – XML Sitemap Fetcher","description":"Pay-per-call web reading for agents: any public page as clean Markdown, link-preview/SEO metadata (Open Graph, Twitter card, favicon, JSON-LD), RSS/Atom/JSON feeds normalized, every link on a page (internal/external, rel) and a site's XML sitemap as a URL list. USDC via x402, no accounts or API keys; failed calls are never charged.\n\nPayments: x402 v2, scheme \"exact\", USDC on Base (eip155:8453). The payment is verified before the work and settled only when the response is 200. Terms: https://reader.scrapemole.workers.dev/terms","url":"https://reader.scrapemole.workers.dev/v1/sitemap?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","required":["url"],"properties":{"url":{"type":"string","examples":["https://www.sitemaps.org"],"description":"Site URL (e.g. https://example.com) or a sitemap .xml/.xml.gz URL."},"limit":{"type":"string","default":"1000","description":"Max page URLs returned (1-5000)."},"expand":{"type":"string","default":"true","description":"For a sitemap index, also read the first child sitemaps (true/false)."}},"additionalProperties":false}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":{"type":"json","example":{"url":"https://www.sitemaps.org/","type":"urlset","urls":[{"url":"https://www.sitemaps.org/","lastmod":"2016-11-21"},{"url":"https://www.sitemaps.org/protocol.html","lastmod":"2016-11-21"}],"count":2,"truncated":false,"sitemapUrl":"https://www.sitemaps.org/sitemap.xml","discoveredVia":"robots.txt"}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.002","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.002/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_Ak-aPzZ4zR1g7oxFXl5Eq","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.002","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches and parses a site's XML sitemap, returning a normalized list of page URLs with optional metadata like lastmod dates","exampleAgentPrompt":"Can you pull the sitemap for stripe.com and give me a list of all the pages they have indexed, up to 500 URLs?","exampleUseCases":[{"title":"SEO audit page inventory","prompt":"Fetch the sitemap for my competitor's site at acmecorp.com and list all their published pages so I can see what content they're putting out — up to 2000 URLs please."},{"title":"Content gap analysis for a blog","prompt":"Get all the URLs from the sitemap at blog.hubspot.com so I can compare their article coverage against ours and find topics they cover that we don't."},{"title":"Automated site re-crawl trigger","prompt":"Pull the sitemap from https://docs.example.com/sitemap.xml and return all the page URLs with their lastmod dates so I can figure out which pages have been updated recently."}],"resultDescription":"A JSON object containing the resolved sitemap URL, the sitemap type (urlset or sitemapindex), an array of URL entries each with url and optional lastmod fields, total count, a truncated flag indicating if the limit was hit, and how the sitemap was discovered (e.g. via robots.txt or direct URL).","failureModes":["Site has no sitemap.xml and no robots.txt sitemap directive — returns error or empty result","Sitemap URL is malformed or unreachable — HTTP error returned, no charge","Sitemap is a large index with many children — only first child sitemaps expanded if expand=true","Limit parameter exceeded maximum of 5000 — capped silently","Gzip-compressed sitemap.xml.gz parsing fails on malformed content","Payment verification fails — request rejected before any work is done, no charge"],"whenToPreferThis":"Use this endpoint when you need to enumerate all publicly indexed pages on a site without crawling it manually. It is ideal for SEO audits, content discovery, competitor analysis, or seeding a crawl queue. Prefer this over fetching the page links endpoint when you want the authoritative publisher-declared URL list rather than scraped anchor tags, and when you need lastmod freshness signals.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-12T12:38:15.861Z","isFirstParty":false,"canonicalSlug":"scrapemole-reader-xml-sitemap-fetcher-7a48a21c"}