{"uid":"cap_KGVQ2mV3sCmP05r5ykWu1","slug":"sitemap-reader-list-site-urls-with-lastmod-0721b8ea","name":"Sitemap Reader: List Site URLs with lastmod","description":"Sitemap reader: list a site's URLs with lastmod (handles sitemap indexes) — Genesis402 / UnyKorn Operator Network","url":"https://twin.unykorn.org/web/sitemap?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"params":{"type":"object","properties":{"site":{"type":"string","description":"required: domain, site URL or sitemap .xml URL"},"limit":{"type":"integer","maximum":1000,"minimum":1,"description":"optional: max rows (default 200, max 1000)"}}}}},"responseSchema":{"type":"json","example":{"ok":true,"type":"sitemap","receipt":{"tx_hash":"0x<64hex>","amount_usd":0.002,"receipt_id":"g402-<16hex>"},"sources":[{"ok":true,"name":"<source>"}],"limitations":"<text>","generated_at":"<iso time>","evidence_hash":"sha256:<64hex>"}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.002","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.002/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_FmkqbUYMHnfptVvUBqsyH","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.002","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches and parses a website's sitemap (including sitemap index files) and returns a list of URLs with their last-modified timestamps","exampleAgentPrompt":"Can you pull all the URLs from the sitemap of nytimes.com — including last-modified dates — and give me up to 500 entries?","exampleUseCases":[{"title":"Audit a site's published pages","prompt":"Get me a list of all the pages on stripe.com from their sitemap, with last-modified dates. Show up to 1000 results so I can see what content they publish."},{"title":"Track content freshness for SEO","prompt":"Pull the sitemap for shopify.com and tell me which URLs have been updated most recently — I want to see the lastmod dates for up to 200 pages."},{"title":"Discover pages before scraping","prompt":"Before I start scraping, can you read the sitemap at https://docs.anthropic.com/sitemap.xml and list all the URLs it contains so I know what pages exist?"}],"resultDescription":"A structured list of URLs found in the site's sitemap, each accompanied by its lastmod timestamp (when available). Handles both simple sitemap.xml files and sitemap index files that reference multiple sub-sitemaps, returning up to the specified limit (default 200, max 1000) of URL entries.","failureModes":["Site has no sitemap.xml and none is discoverable — returns empty or error","Sitemap is malformed or non-standard XML — parse error","Domain does not exist or is unreachable — network/timeout error","Sitemap is extremely large and limit is reached — partial results up to limit","Password-protected or robots.txt-blocked sitemap — access denied"],"whenToPreferThis":"Use this endpoint when you need to enumerate all publicly indexed pages of a website, especially when you want last-modified dates to prioritize fresh content. It is superior to manual URL discovery because it handles both flat sitemaps and sitemap index files automatically. Ideal for SEO audits, pre-crawl URL discovery, content monitoring, and competitive research where you need a full list of a site's pages without scraping every page.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-01T12:52:01.802Z","isFirstParty":false,"canonicalSlug":"sitemap-reader-list-site-urls-with-lastmod-0721b8ea"}