{"uid":"cap_3Lkuj3mQlJzcf1W5-8Xlp","slug":"mcp-security-agentdiet-dev-automated-llms-txt-agent-documentation-aaf1b81f","name":"Automated /llms.txt & Agent Documentation Context Compiler","description":"Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle. (Live x402 v2, IETF MPP & MCP endpoint at https://mcp-security.agentdiet.dev/v1/agent-card)","url":"https://mcp-security.agentdiet.dev/v1/agent-card?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","required":["url"],"properties":{"url":{"type":"string","minLength":1,"description":"Website URL to crawl and generate a ready-to-consume /llms.txt manifest for"}}},"responseSchema":{"type":"object"},"example":null,"exampleRequest":null,"tags":[],"displayCostAmount":"0.01","displayCostAsset":"USD","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_5swmQz8uNqjr2nwqI47Fn","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fcd6edb6e08f4c7c32d4f71b54bda02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":"mcp-security.agentdiet.dev","brandSlug":"mcp-security-agentdiet-dev-mpp","brandBaseUrl":"https://mcp-security.agentdiet.dev","brandDocsUrl":null,"whatItDoes":"Crawls any documentation or SaaS website and generates a standards-compliant /llms.txt manifest plus JSON-LD schema bundle for LLM/agent consumption","exampleAgentPrompt":"Crawl the docs at https://stripe.com/docs and generate a standards-compliant /llms.txt manifest and JSON-LD schema bundle so AI agents can consume the content.","exampleUseCases":[{"title":"LLM-ify a SaaS product docs site","prompt":"Take the documentation at https://docs.notion.so and compile a ready-to-use /llms.txt manifest and JSON-LD bundle so my AI agent can understand what Notion's API can do."},{"title":"Make internal API docs agent-accessible","prompt":"I have an internal developer portal at https://developers.mycompany.com — can you crawl it and generate a standards-compliant /llms.txt file so our agents can reference it?"},{"title":"Prepare open-source project docs for MCP","prompt":"Crawl the docs at https://docs.langchain.com and produce a JSON-LD schema bundle and /llms.txt manifest so I can plug it into an MCP-compatible agent workflow."}],"resultDescription":"Returns a standards-compliant /llms.txt manifest and a JSON-LD schema bundle extracted from the crawled site, structured for direct consumption by LLMs and AI agents. The output enables agents to understand the documentation structure, available APIs, and content hierarchy of the target site.","failureModes":["Invalid or unreachable URL returns an error with no manifest output","Paywalled or login-gated documentation sites may yield incomplete or empty manifests","Very large documentation sites may produce truncated output if crawl depth is limited","Non-documentation pages (e.g. marketing homepages) may yield low-signal manifests","Payment failure (HTTP 402) if x402 micropayment is not correctly attached"],"whenToPreferThis":"Choose this endpoint when you need to make any documentation or SaaS website machine-readable for LLMs/agents by generating a standards-compliant /llms.txt and JSON-LD schema — especially when the target site does not already provide one. Prefer this over manual context extraction when you need a structured, reusable manifest rather than a one-off scrape.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-21T07:23:13.115Z","isFirstParty":false,"canonicalSlug":"mcp-security-agentdiet-dev-automated-llms-txt-agent-documentation-25fa08f0"}