{"uid":"cap_ifSqWvUetXbSnHyqZIFp4","slug":"sitemap-url-extractor-622e4135","name":"Sitemap URL Extractor","description":"Guides and free-to-run Apify actors for bulk tech stack lookup, sitemap URL export to CSV, TED and UK Find a Tender search, and RSS-to-JSON feed monitoring.","url":"https://tools.adamhaleworks.workers.dev/x402/v1/sitemap-urls?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","required":["url"],"properties":{"url":{"type":"string","description":"A domain (sitemaps found via robots.txt or common paths) or the URL of one sitemap file."},"format":{"enum":["json","csv"],"type":"string","description":"json (default) or csv."}}}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":{"type":"json","example":{"site":"https://github.blog","urls":[{"url":"https://github.blog/latest/","lastmod":"2026-10-08T18:13:52+00:00","sitemap":"https://github.blog/post-sitemap.xml"}],"files":[{"url":"https://github.blog/sitemap_index.xml","kind":"index","urls":0,"children":17}],"capped":true,"source":"robots.txt","totalUrls":5000}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.004","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.004/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.004","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.004","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_NGVKwX7Xn8qe5k7xuQIeu","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.004","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Crawls a website or sitemap file and returns all sitemap URLs with metadata in JSON or CSV format","exampleAgentPrompt":"Can you pull all the sitemap URLs for github.blog and give them to me as JSON, including their last-modified dates?","exampleUseCases":[{"title":"SEO audit for a competitor site","prompt":"I need a full list of all indexed pages on techcrunch.com — can you crawl their sitemap and export every URL with its last-modified date as JSON?"},{"title":"Content inventory for a client website","prompt":"Get me all the URLs from https://www.acmecorp.com/sitemap.xml so I can audit what pages they currently have published."},{"title":"Feed monitoring and page discovery","prompt":"Can you discover all the sitemap files on shopify.com via their robots.txt and give me back the complete list of page URLs in CSV format?"}],"resultDescription":"Returns a JSON (or CSV) object containing the target site domain, a list of all discovered URLs each with its URL string, last-modified timestamp, and source sitemap filename, plus metadata about the sitemap files found (URL, kind, child count), whether the result was capped at the limit, how the sitemaps were sourced (e.g. robots.txt), and a total URL count.","failureModes":["Domain has no sitemap or robots.txt entry — returns empty or minimal result","Sitemap is malformed XML — parsing may fail or return partial results","Site blocks crawl bots — may return empty results","URL cap reached — capped flag set to true, not all URLs returned","Invalid URL input — request may error or return no results"],"whenToPreferThis":"Use this endpoint when you need to programmatically discover all indexed pages on a website via its sitemap, especially for SEO audits, content inventories, or web scraping prep. It handles sitemap index files, nested sitemaps, and robots.txt discovery automatically, making it superior to manually fetching and parsing individual sitemap XML files. It also supports CSV output for spreadsheet-ready exports.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-16T06:38:46.233Z","isFirstParty":false,"canonicalSlug":"sitemap-url-extractor-622e4135"}