{"uid":"cap_WUN9FBEr76xUU7KdA-bmr","slug":"ai-crawler-access-watch-389cc959","name":"AI Crawler Access Watch","description":"Register a standing watch over a set of URLs and pre-buy pull credits. POST {\"urls\":[...],\"credits\":10}; we keep those URLs in the AI-crawler-access census. Pull with POST /v1/watch/pull {\"watchId\":...} to get what changed since your last pull. Watches expire after 30 days unless refreshed by activity. For agents that need ongoing monitoring of whether sites serve, refuse, or tollgate AI crawlers like GPTBot and ClaudeBot.","url":"https://tizona-outpost.venusberg.workers.dev/v1/watch/register","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"urls":{"type":"array","items":{"type":"string"}},"credits":{"type":"integer"}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_5newcWWcZEU53mpYMd4EV","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Register a standing watch over a list of URLs to monitor how sites treat AI crawlers (GPTBot, ClaudeBot, etc.) and pull changes on demand using pre-bought credits.","exampleAgentPrompt":"Set up a standing watch on these 5 URLs — https://example.com, https://news-site.com, https://shop.com, https://blog.example.org, https://forum.site.net — with 10 pull credits, so I can track whether they start blocking or allowing AI crawlers like GPTBot and ClaudeBot over time.","exampleUseCases":[{"title":"SEO tool tracking crawler policy drift","prompt":"Register a watch on these 20 publisher URLs with 10 credits so I can pull weekly and see which ones have started blocking or tollgating AI crawlers since last time."},{"title":"Competitor AI access monitoring","prompt":"Set up ongoing monitoring for https://openai.com, https://anthropic.com, https://cohere.com, and https://mistral.ai with 15 credits — I want to detect any time one of them changes how they treat AI crawlers."},{"title":"LLM training data compliance audit","prompt":"I need to register a persistent watch over a list of 50 news domains with 20 pre-bought pull credits so my agent can check back regularly and report whenever any site flips from allowing to refusing GPTBot or ClaudeBot."}],"resultDescription":"Returns a watchId that identifies the registered watch session. Subsequent pulls via /v1/watch/pull with that watchId return a delta of what changed in AI crawler access status (served, refused, or tollgated) for each monitored URL since the last pull. Watches remain active for 30 days, refreshed by activity.","failureModes":["Invalid or malformed URLs in the array — returns validation error","Insufficient credits value (zero or negative) — rejected at registration","watchId not found or expired on pull — watch may have lapsed after 30 days of inactivity","Rate limiting or payment failure — x402 payment required per call","Empty URL list — endpoint may reject or return no-op response"],"whenToPreferThis":"Choose this endpoint when you need ongoing, asynchronous monitoring of AI crawler policies across multiple URLs rather than a one-shot bulk check. It is preferable over the sibling triage endpoint when you need persistent tracking with change deltas over days or weeks, and when pre-buying pull credits is more efficient than paying per triage call. Ideal for agents running scheduled compliance audits, competitive intelligence pipelines, or LLM training data sourcing workflows.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-14T18:34:47.296Z","isFirstParty":false}