{"uid":"cap_1V6WAqZ-KOa3GtEY6GIZX","slug":"sitecheck-llms-txt-reader-6aa93b01","name":"SiteCheck llms.txt Reader","description":"Whether a site publishes /llms.txt and /llms-full.txt: the parsed llms.txt (title, summary, sections with their links) and the size of llms-full.txt. Reads the site itself, through the same URL guard and size cap as the page tools.","url":"https://api.sitecheck-api.workers.dev/api/llms-txt?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","required":["url"],"properties":{"url":{"type":"string","description":"Site address, https://…"}}}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":{"type":"json","example":{"site":"https://developers.cloudflare.com","source":"https://developers.cloudflare.com/llms.txt, https://developers.cloudflare.com/llms-full.txt","llmsTxt":{"bytes":16925,"title":"Cloudflare Developer Documentation","exists":true,"summary":"Each product below links to its own llms.txt, which contains a full index of that product's documentation pages and is the recommended way to explore a specific product's content.","sections":[{"name":"Application performance","links":[{"url":"https://developers.cloudflare.com/argo-smart-routing/llms.txt","note":"Route web traffic across the fastest, most reliable network paths","title":"Argo Smart Routing"},{"url":"https://developers.cloudflare.com/automatic-platform-optimization/llms.txt","note":"Improve WordPress site performance by serving it from Cloudflare's global network","title":"Automatic Platform Optimization"},{"url":"https://developers.cloudflare.com/cache/llms.txt","note":"Make websites faster by caching content across our global server network","title":"Cache / CDN"}]},{"name":"Application security","links":[{"url":"https://developers.cloudflare.com/api-shield/llms.txt","note":"Identify and address your API vulnerabilities","title":"API Shield"},{"url":"https://developers.cloudflare.com/bots/llms.txt","note":"Protect your domain from bad bot traffic","title":"Bots"},{"url":"https://developers.cloudflare.com/cloudflare-challenges/llms.txt","note":"Verify visitors are not bots with lightweight challenges","title":"Challenges"}]},{"name":"Cloudflare One","links":[{"url":"https://developers.cloudflare.com/mesh/llms.txt","note":"Connect services and devices with post-quantum encrypted mesh networking","title":"Cloudflare Mesh"},{"url":"https://developers.cloudflare.com/cloudflare-network-firewall/llms.txt","note":"Protect your enterprise network with advanced firewall-as-a-service protection","title":"Cloudflare Network Firewall"},{"url":"https://developers.cloudflare.com/cloudflare-one/llms.txt","note":"Replace legacy security perimeters with Cloudflare's network to protect your organization","title":"Cloudflare One"}]}]},"llmsFull":{"bytes":300000,"exists":true,"truncated":true},"checkedAt":"2026-10-14T07:00:49.304Z"}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.002","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.002/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_3e7dRFfghqegEG1OZpHni","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.002","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches and parses the llms.txt (and llms-full.txt) file from a given website, returning structured AI-readable documentation metadata including title, summary, and section links.","exampleAgentPrompt":"Can you fetch and parse the llms.txt file from https://developers.cloudflare.com so I can see what documentation sections and links they expose for AI agents?","exampleUseCases":[{"title":"Discover AI docs for developer portal","prompt":"Go fetch the llms.txt from https://platform.openai.com and show me all the section names and their links so I know what documentation is available for AI agents."},{"title":"Check if a site supports llms.txt","prompt":"Does https://docs.stripe.com have an llms.txt file? If so, what's its title and summary, and how many sections does it have?"},{"title":"Build documentation index for agent","prompt":"Pull the llms.txt from https://supabase.com and give me a structured list of all the documentation links organized by section — I want to feed them to my agent for RAG."}],"resultDescription":"Returns a JSON object containing the target site URL, the source URLs where llms.txt and/or llms-full.txt were found, and a structured llmsTxt object with: existence flag, byte size, title, summary, and an array of named sections each containing titled links with URLs and optional notes.","failureModes":["Site does not have an llms.txt file — exists field returns false","Invalid or unreachable URL — network error or timeout","URL missing https:// scheme — query param validation failure","Site returns llms.txt but it is malformed or unparseable — partial or empty sections","Rate limiting or Cloudflare Worker errors — HTTP 429 or 5xx"],"whenToPreferThis":"Use this endpoint when you need to programmatically discover and consume AI-readable documentation from a website that follows the llms.txt standard. Prefer it over general web scraping when the goal is specifically to index or navigate a site's structured AI documentation sections, or when building a retrieval pipeline that needs canonical doc links organized by topic.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-28T06:42:34.435Z","isFirstParty":false,"canonicalSlug":"sitecheck-llms-txt-reader-6aa93b01"}