{"uid":"cap_OvoRstexwfmKrC0B3hqyv","slug":"webwache-robots-policy-change-snapshot-57d66094","name":"Webwache Robots Policy Change Snapshot","description":"Robots policy change snapshot fetches current public evidence from the supplied target and evaluates the documented criterion. It returns the observation, threshold, verdict, exact evidence source, limitations and a mode-specific action. The check is passive: no login attempt, payload injection, exploit, purchase, form submission or load test is performed.","url":"https://webwache.halowerk.com/v1/robots-change-snapshot?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"target":{"type":"string","maxLength":2048,"minLength":3,"description":"Public HTTP(S) URL or domain to inspect. A bare domain is normalized to HTTPS."},"context":{"type":"object","description":"Optional non-secret correlation labels returned unchanged only in the request lifecycle.","maxProperties":12,"additionalProperties":{"type":["string","number","boolean","null"]}},"baseline":{"type":["object","null"],"description":"Optional baseline returned by a previous snapshot call.","additionalProperties":true},"compare_url":{"type":"string","maxLength":2048,"minLength":3,"description":"Optional public comparison URL. Used by change and monitoring services."}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.001","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.001/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.001","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.001","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_vSeuEaCcYEakPtLsi8fRY","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.001","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Passively fetches and evaluates the current robots.txt policy of a target URL, returning a structured snapshot with observations, verdict, evidence source, and limitations.","exampleAgentPrompt":"Can you grab a robots.txt snapshot for example.com and check whether its crawl policy has changed compared to the baseline I captured last week?","exampleUseCases":[{"title":"SEO audit robots policy check","prompt":"Pull the current robots.txt snapshot for shop.mystore.com and tell me if anything has changed in crawl rules since the baseline I have from last month."},{"title":"Competitor crawl policy monitoring","prompt":"Check competitor-site.com's robots.txt right now and flag if any new paths have been disallowed that weren't there before — compare it to this baseline snapshot."},{"title":"Pre-launch site compliance verification","prompt":"Before we go live, can you snapshot the robots.txt on staging.mybrand.com and verify that the crawl policy is consistent with what we documented earlier?"}],"resultDescription":"Returns a structured object containing the observed robots.txt content, an evaluated verdict against the documented criterion, threshold details, the exact evidence source URL, known limitations of the passive check, and a mode-specific recommended action. If a baseline was provided, change detection output is included.","failureModes":["Target URL is unreachable or returns a non-200 status — endpoint reports observation as unavailable","Target has no robots.txt — returns observation with empty or default policy, verdict reflects absence","Malformed or non-HTTP(S) URL input — returns validation error","Compare URL is inaccessible — comparison segment of response may be incomplete","Robots.txt is extremely large — may be truncated per maxLength constraints"],"whenToPreferThis":"Use this endpoint when you need a lightweight, passive snapshot of a domain's robots.txt policy at a point in time, especially for change detection workflows where a prior baseline exists. It is preferable over general web scraping tools when the specific goal is robots policy auditing, SEO compliance monitoring, or tracking crawl permission drift — without triggering logins, form submissions, or any active site interaction.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-11-16T18:35:03.425Z","isFirstParty":false,"canonicalSlug":"webwache-robots-policy-change-snapshot-57d66094"}