{"uid":"cap_ySPuYhKuYVcOo84Jbw2BV","slug":"url-preflight-check-e27188a6","name":"URL Preflight Check","description":"URL preflight - status, redirect chain, key headers, response time, robots.txt rules for the path and sitemap location","url":"https://x240.jvnclk88.workers.dev/url/check?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"url":{"type":"string","description":"Public http or https URL to fetch"}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.002","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.002/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_LAXG9rLcVxOXJhVIVByBw","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.002","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches a URL and returns its HTTP status, full redirect chain, key response headers, response time, robots.txt rules for the path, and sitemap location","exampleAgentPrompt":"Before I scrape it, can you do a preflight check on https://example.com/pricing — I want to know if it's reachable, whether it redirects anywhere, how fast it responds, and whether it's blocked by robots.txt?","exampleUseCases":[{"title":"Validate URLs before batch scrape","prompt":"I have a list of URLs I want to scrape — can you preflight check https://shop.example.com/products first to see if it's live, if there are any redirects, and if robots.txt will block us?"},{"title":"Debug a broken link redirect chain","prompt":"This link https://old.example.com/blog/post-123 seems to be bouncing around — can you trace the full redirect chain for me so I can see where it ends up?"},{"title":"SEO audit of robots and sitemap","prompt":"I'm auditing the site at https://www.mybrand.com/about — can you check whether that page is allowed by robots.txt and tell me where the sitemap is located?"}],"resultDescription":"Returns a JSON object containing the final HTTP status code, the complete redirect chain (each hop's URL and status), key response headers (e.g. Content-Type, Cache-Control, X-Robots-Tag), the total response time in milliseconds, the robots.txt rules applicable to the requested path (allow/disallow), and the sitemap URL if discoverable.","failureModes":["Invalid or malformed URL returns a validation error","Private or non-public URLs (e.g. localhost, internal IPs) are rejected","DNS resolution failures result in a connection error response","Very slow or timing-out URLs may return a timeout error","Some servers block automated requests (403 Forbidden) which is reflected in the status"],"whenToPreferThis":"Use this endpoint when you need to verify a URL's reachability, understand its redirect behavior, check its robots.txt accessibility rules, or gather key HTTP headers before committing to a full scrape or crawl. It is ideal as a preflight step in any web automation pipeline to avoid wasting resources on dead links, redirect loops, or blocked pages.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-29T00:32:45.102Z","isFirstParty":false,"canonicalSlug":"url-preflight-check-e27188a6"}