{"uid":"cap_RfvR_R31XLgpS0uT9yKq7","slug":"generic-crawler-access-decision-f989e44c","name":"Generic Crawler Access Decision","description":"Generic crawler access decision fetches current public evidence from the supplied target and evaluates the documented criterion. It returns the observation, threshold, verdict, exact evidence source, limitations and a mode-specific action. The check is passive: no login attempt, payload injection, exploit, purchase, form submission or load test is performed.","url":"https://agentreadiness.halowerk.com/v1/generic-agent-access-decision?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"target":{"type":"string","maxLength":2048,"minLength":3,"description":"Public HTTP(S) URL or domain to inspect. A bare domain is normalized to HTTPS."},"context":{"type":"object","description":"Optional non-secret correlation labels returned unchanged only in the request lifecycle.","maxProperties":12,"additionalProperties":{"type":["string","number","boolean","null"]}},"baseline":{"type":["object","null"],"description":"Optional baseline returned by a previous snapshot call.","additionalProperties":true},"compare_url":{"type":"string","maxLength":2048,"minLength":3,"description":"Optional public comparison URL. Used by change and monitoring services."}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.001","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.001/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.001","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.001","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_dJV5weWcoa-0rYPDdsfkp","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.001","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Passively evaluates whether a generic web crawler can access a target URL and returns a structured verdict with evidence, thresholds, and recommended actions.","exampleAgentPrompt":"Can you check whether generic web crawlers are allowed to access https://example.com and give me a verdict with evidence on whether it's actually crawlable?","exampleUseCases":[{"title":"Pre-launch crawler readiness check","prompt":"Before we go live, can you check if https://myblog.com is accessible to generic web crawlers and tell me what evidence you found, what the verdict is, and if there are any limitations I should know about?"},{"title":"Diagnosing blocked crawler access","prompt":"Our site https://shop.acmecorp.com seems to be invisible to some automated tools — can you passively evaluate whether generic crawlers can actually access it and explain what's blocking them?"},{"title":"Comparing crawler access across two sites","prompt":"Can you assess crawler accessibility for https://site-a.com using https://site-b.com as a comparison URL and tell me how their crawl policies differ?"}],"resultDescription":"Returns a structured response containing the observation (what was found on the target), the threshold used to evaluate it, a pass/fail verdict, the exact evidence source URL, any limitations of the check, and a mode-specific recommended action. No active probing, login, exploit, or form submission is performed.","failureModes":["Invalid or unreachable target URL returns an error with no verdict","Target behind authentication or paywall cannot be evaluated passively","Rate-limited or bot-blocking targets may return incomplete evidence","Malformed URL input (too short or too long) rejected by schema validation","Baseline mismatch if provided baseline schema is incompatible"],"whenToPreferThis":"Choose this endpoint when you need a passive, read-only evaluation of whether a generic web crawler can access a specific public URL or domain. It is ideal for pre-publication site audits, diagnosing crawler access issues, or validating agent readiness without any active exploitation, login attempts, or load testing. Prefer sibling endpoints for specific crawler types (e.g. PerplexityBot) or structured content checks (e.g. llms.txt, article boundaries).","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-14T00:36:13.068Z","isFirstParty":false,"canonicalSlug":"generic-crawler-access-decision-f989e44c"}