{"uid":"cap_6G2dwHClR3R5Mxdnzu8Tl","slug":"agentread-sitemap-fetcher-b80f6e8b","name":"agentread – Sitemap Fetcher","description":"Read a URL your own fetch failed on and get the page text back, or a verdict explaining why it cannot be read. Built for agents that just got a 403, 429, empty body or JS shell.","url":"https://agentread.midi-thumb.workers.dev/sitemap?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type"],"properties":{"type":{"const":"http"},"method":{"const":"GET"}},"additionalProperties":true},"output":{"type":"object","additionalProperties":true}}},"responseSchema":{"type":"json","example":{}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_cvRNJx4UiLHW70ji5jWma","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches and returns the sitemap of a target domain when the agent's own HTTP request fails due to access restrictions or JS rendering barriers.","exampleAgentPrompt":"I just got a 403 trying to fetch the sitemap for a site — can you use agentread to grab the sitemap text for me so I can see what pages are listed there?","exampleUseCases":[{"title":"Unblock sitemap behind anti-bot wall","prompt":"My fetch of the site's sitemap keeps returning 403 — can you use agentread to retrieve it and tell me what URLs are listed?"},{"title":"Recover sitemap after rate limiting","prompt":"I'm getting 429 errors every time I try to pull down the sitemap — use agentread to get the sitemap page text for me instead."},{"title":"Read JS-rendered sitemap page","prompt":"The sitemap URL just returns an empty body or a JavaScript shell when I fetch it directly — can agentread retrieve the actual content for me?"}],"resultDescription":"Returns the raw text content of the sitemap page if successfully retrieved, or a structured verdict explaining why the page cannot be read (e.g. paywalled, permanently blocked, non-existent).","failureModes":["Page is genuinely inaccessible or does not exist — returns an explanatory verdict rather than content","Target site uses CAPTCHA that cannot be bypassed — returns failure verdict","Network timeout or upstream unreachable — returns error response","Sitemap URL is malformed or not a valid HTTP target — input rejected"],"whenToPreferThis":"Use this endpoint specifically when a prior direct fetch of a sitemap has failed with a 403, 429, empty body, or JS-only shell — it is purpose-built for agent fallback scenarios rather than general-purpose crawling or content scraping.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-31T18:37:52.656Z","isFirstParty":false,"canonicalSlug":"agentread-sitemap-fetcher-b80f6e8b"}