{"uid":"cap_Gi3wHxsRdICo2emxttEf4","slug":"agentbit-website-ai-readiness-auditor-a47611e2","name":"AgentBit Website AI-Readiness Auditor","description":"Audit any website for AI-agent and AI-crawler readiness: HTTPS, robots.txt and AI bot rules (GPTBot, ClaudeBot, PerplexityBot), llms.txt, sitemap, title/meta, schema.org JSON-LD, security headers. Returns a 0–100 score with failed checks, issues and concrete recommendations.","url":"https://agentbit.app/v1/website/agent-readiness","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"url":{"type":"string"}}},"responseSchema":{"type":"json","example":{"url":"https://example.com","score":55,"checks":{"https":{"pass":true},"llms_txt":{"pass":false},"robots_txt":{"pass":false},"schema_org":{"pass":false}},"issues":["Check failed: robots_txt","Check failed: llms_txt"],"recommendations":["Publish an llms.txt file describing your site for AI agents.","Add schema.org structured data (JSON-LD)."]}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.05","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.05/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.05","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.05","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_7-3r-_NQZFr_AGrDvQNgm","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.05","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Audits any public website for AI-agent and AI-crawler readiness, returning a 0–100 score with detailed checks, issues, and recommendations across HTTPS, robots.txt, llms.txt, sitemap, meta tags, schema.org JSON-LD, and security headers.","exampleAgentPrompt":"Can you audit https://example.com and tell me how AI-agent ready it is — check things like robots.txt bot rules, llms.txt, sitemap, schema.org markup, and security headers, and give me a score with recommendations?","exampleUseCases":[{"title":"Pre-launch AI discoverability check","prompt":"Before we go live, can you audit https://mynewstartup.com for AI-agent readiness and tell me what we need to fix so bots like GPTBot and ClaudeBot can properly crawl and understand it?"},{"title":"Competitor AI-readiness benchmarking","prompt":"Can you check how AI-ready https://competitor.com is — give me the score, which AI crawler rules they have in robots.txt, whether they have llms.txt, and the top issues you find?"},{"title":"Client website SEO and AI audit report","prompt":"I need to audit https://clientsite.io for AI-agent and crawler readiness — look at their HTTPS, robots.txt AI bot rules, schema.org JSON-LD, sitemap, and security headers, then give me a 0–100 score with specific recommendations I can share with them."}],"resultDescription":"A structured JSON response containing a 0–100 AI-readiness score for the submitted URL, along with the pass/fail status for each check (HTTPS, robots.txt AI bot rules for GPTBot/ClaudeBot/PerplexityBot, llms.txt presence, sitemap, title/meta tags, schema.org JSON-LD, security headers), a list of identified issues, and concrete actionable recommendations to improve the score.","failureModes":["URL is unreachable or returns a non-200 status — audit may fail or return partial results","Private or localhost URLs may not be accessible from the auditor","Malformed URL input causes validation error","Timeout if the target website is extremely slow to respond","Sites behind Cloudflare or bot-detection may block the auditor's requests"],"whenToPreferThis":"Use this endpoint when you need a structured, scored audit of a website's readiness for AI agents and crawlers specifically — covering AI-specific signals like llms.txt, GPTBot/ClaudeBot robots.txt rules, and schema.org JSON-LD — rather than a general SEO audit or uptime check. It is the right choice when the goal is to improve a site's discoverability and usability by AI systems.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-13T18:55:58.648Z","isFirstParty":false}