{"uid":"cap_j539ByHtdtylsJUBJJIS-","slug":"forest-web-sitemap-finder-5b096a4e","name":"Forest Web - Sitemap Finder","description":"Machine-readable contract for active Forest paid capabilities. Unsigned paid calls return HTTP 402 with a PAYMENT-REQUIRED x402 challenge.","url":"https://http--forest-gas-station-mainnet--lcjl27p8lmjs.code.run/sitemap/find?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"url":{"type":"string","pattern":"^https?://","maxLength":2048,"minLength":1,"description":"Public HTTP(S) URL to inspect, resolve, or compare."}}},"responseSchema":{"type":"json","example":{"ok":true,"data":{"found":false,"scope":"sitemap_discovery_only_no_crawl","origin":"example","probes":[],"sitemaps":[],"robots_url":"example","target_url":"example","robots_state":"available","requests_made":1,"robots_status":1,"rendered_javascript":false},"meta":{"cache":"miss","provider":"robots-txt","checked_at":"2026-01-01T00:00:00.000Z","duration_ms":0},"version":"1","capability":"web.sitemap-find"}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.002","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.002/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_1d2Z1cmpmV0-7Hovu9U60","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.002","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Discovers a website's sitemap by reading robots.txt declarations and checking conventional sitemap.xml/sitemap_index.xml locations, returning verified evidence without crawling pages","exampleAgentPrompt":"Before I start crawling https://www.shopify.com, can you find where their sitemap is located — check their robots.txt and the standard sitemap.xml and sitemap_index.xml paths?","exampleUseCases":[{"title":"Pre-crawl sitemap discovery for scraper","prompt":"I'm about to scrape https://www.nytimes.com — can you first find their sitemap location so I know where to start? Check their robots.txt and the standard paths."},{"title":"SEO audit sitemap verification","prompt":"I'm auditing https://www.hubspot.com for SEO — can you find whether they have a declared sitemap in their robots.txt or at the conventional sitemap.xml location?"},{"title":"Indexing pipeline bootstrap","prompt":"Before I build my search index for https://docs.python.org, locate any available sitemap so I can prioritize which pages to fetch."}],"resultDescription":"Returns verified sitemap discovery evidence including whether a sitemap was found in robots.txt declarations and/or at conventional same-origin locations (sitemap.xml, sitemap_index.xml), with the resolved sitemap URLs — without actually crawling the sitemap entries or any site pages.","failureModes":["No sitemap found — site has neither robots.txt declarations nor standard sitemap.xml/sitemap_index.xml files","URL unreachable or returns non-2xx response — cannot inspect robots.txt","Malformed or non-HTTP(S) URL input returns validation error","robots.txt declares a sitemap at an inaccessible cross-origin location","Rate limiting or network timeout on the target domain"],"whenToPreferThis":"Use this endpoint when you need to locate a site's sitemap before beginning a crawl, especially to avoid guessing sitemap paths or wasting requests on non-existent files. Prefer this over a full crawl when you only need the sitemap location, not its contents. It is ideal as a first step in any web indexing, SEO auditing, or content discovery pipeline where knowing the canonical sitemap URL is prerequisite to further processing.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-20T12:35:04.147Z","isFirstParty":false,"canonicalSlug":"forest-web-sitemap-finder-5b096a4e"}