{"uid":"cap_npr1SoUVW7sPA6RlBgPkA","slug":"mcp-security-agentdiet-dev-automated-llms-txt-agent-documentation-6a87372c","name":"Automated /llms.txt & Agent Documentation Context Compiler","description":"Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle. (Live x402 v2, IETF MPP & MCP endpoint at https://mcp-security.agentdiet.dev/v1/llms-txt)","url":"https://mcp-security.agentdiet.dev/v1/llms-txt?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","required":["url"],"properties":{"url":{"type":"string","minLength":1,"description":"Website URL to crawl and generate a ready-to-consume /llms.txt manifest for"}}},"responseSchema":{"type":"object"},"example":null,"exampleRequest":null,"tags":[],"displayCostAmount":"0.01","displayCostAsset":"USD","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_q72TKv-zkkK37MX6t8xUd","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fcd6edb6e08f4c7c32d4f71b54bda02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":"mcp-security.agentdiet.dev","brandSlug":"mcp-security-agentdiet-dev-mpp","brandBaseUrl":"https://mcp-security.agentdiet.dev","brandDocsUrl":null,"whatItDoes":"Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle for AI agent consumption","exampleAgentPrompt":"Can you crawl the documentation at https://stripe.com/docs and generate a standards-compliant /llms.txt manifest and JSON-LD schema bundle so AI agents can properly understand and navigate the site?","exampleUseCases":[{"title":"Making SaaS docs AI-agent-ready","prompt":"Crawl the documentation at https://docs.notion.so and compile a proper /llms.txt manifest so that AI agents can discover and understand Notion's API and features."},{"title":"Onboarding new API into agent pipeline","prompt":"Generate an llms.txt manifest and JSON-LD schema bundle for https://platform.openai.com/docs — I want to feed it into my agent so it can reason about OpenAI's API capabilities."},{"title":"Publishing agent context for my own product","prompt":"I just launched my SaaS at https://docs.myapp.io — can you crawl it and produce a standards-compliant /llms.txt file I can host so AI agents know how to interact with my product?"}],"resultDescription":"Returns a standards-compliant /llms.txt manifest and JSON-LD schema bundle compiled from the crawled website, structured for direct consumption by AI agents and LLMs. Includes hierarchical documentation context, links, and semantic metadata derived from the target site.","failureModes":["Target URL is unreachable or returns non-200 status — crawl fails with error","URL points to login-gated or paywalled content — incomplete or empty manifest","Very large documentation sites may yield truncated output due to token/page limits","Malformed or JavaScript-heavy SPAs may not yield enough static content to parse","Invalid or missing `url` parameter returns a 400-level error"],"whenToPreferThis":"Choose this endpoint when you need to make any external documentation or SaaS website consumable by AI agents via the emerging /llms.txt standard. It is especially useful when onboarding a third-party API or docs site into an agent pipeline, when you want to self-host an /llms.txt for your own product, or when you need a JSON-LD schema bundle alongside the manifest. Prefer this over manually authoring /llms.txt files or generic web scrapers that don't produce agent-standard output.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-21T07:25:57.647Z","isFirstParty":false,"canonicalSlug":"mcp-security-agentdiet-dev-automated-llms-txt-agent-documentation-25fa08f0"}