{"uid":"cap_qt3gf6aah48UYsxwA7KwG","slug":"apex-sitemap-url-list-fccc2ffd","name":"APEX Sitemap URL List","description":"Sitemap reader: every URL a website publishes, from robots.txt and its sitemaps, with last-modified dates. Every URL a website publishes, from its own sitemaps: pass ?url= and we read robots.txt for Sitemap: lines (else /sitemap.xml and /sitemap_index.xml), follow nested sitemap indexes and gzipped files, and return each URL with its lastmod, up to 5,000. Unreadable files are listed with the reason. A site with no sitemap is answered before any charge.","url":"https://apexfaucet.xyz/api/x402/site-map?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method","queryParams"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","required":["url"],"properties":{"url":{"type":"string","pattern":"^https?://","description":"Any page of the site (its origin is used): robots.txt, then its sitemaps, are read."}}}}},"output":{"type":"object"}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.003","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.003/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.003","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.003","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_OgDBHoKtx1KbWwUpsWkgl","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.003","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Reads a website's robots.txt and sitemaps to return all published URLs with their last-modified dates, up to 5,000 entries.","exampleAgentPrompt":"Can you get me the full list of URLs that example.com publishes in its sitemap, including any last-modified dates?","exampleUseCases":[{"title":"Full site URL inventory for SEO audit","prompt":"Pull every URL that stripe.com has in its sitemap — I need the complete list with last-modified dates so I can audit their content coverage."},{"title":"Monitor competitor content additions","prompt":"Fetch all the pages that competitor.com publishes in its sitemap right now so I can compare it against last week's list and spot any new content they've added."},{"title":"Pre-crawl URL discovery for a scraper","prompt":"Before I start scraping, can you read the sitemap for docs.python.org and give me every URL it lists so I know exactly which pages to target?"}],"resultDescription":"A list of up to 5,000 URLs published by the target website, each with its lastmod date if available. Includes entries for any sitemap files that could not be read, along with the reason for failure. If no sitemap is found, the response indicates this before any charge is made.","failureModes":["Site has no sitemap — returns a no-sitemap response before charging","Sitemap file is malformed or unreadable — listed with failure reason","robots.txt is inaccessible — falls back to /sitemap.xml and /sitemap_index.xml","Site returns non-200 status on sitemap URLs — logged as unreadable","More than 5,000 URLs in sitemap — truncated at 5,000"],"whenToPreferThis":"Use this endpoint when you need a complete, structured list of all URLs a website officially publishes via its sitemap, including last-modified dates. Prefer it over generic web crawlers when you want only the URLs the site itself declares (not discovered by link-following), and when you need nested sitemap index traversal and gzip support handled automatically. Ideal for SEO audits, content monitoring, and pre-crawl URL discovery.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-01T00:45:54.043Z","isFirstParty":false,"canonicalSlug":"apex-sitemap-url-list-fccc2ffd"}