{"uid":"cap_2d-dKd-X96XgX-Cn61dq4","slug":"defi-yield-agentdiet-dev-automated-llms-txt-agent-documentation-bc53bec7","name":"Automated /llms.txt & Agent Documentation Context Compiler","description":"Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle. (Live x402 v2, IETF MPP & MCP endpoint at https://defi-yield.agentdiet.dev/v1/llms-txt)","url":"https://defi-yield.agentdiet.dev/v1/llms-txt?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","required":["url"],"properties":{"url":{"type":"string","minLength":1,"description":"Website URL to crawl and generate a ready-to-consume /llms.txt manifest for"}}},"responseSchema":{"type":"object"},"example":null,"exampleRequest":null,"tags":[],"displayCostAmount":"0.01","displayCostAsset":"USD","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_LS27W6goiB7YNDNKLsAnu","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fcd6edb6e08f4c7c32d4f71b54bda02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":"defi-yield.agentdiet.dev","brandSlug":"defi-yield-agentdiet-dev-mpp","brandBaseUrl":"https://defi-yield.agentdiet.dev","brandDocsUrl":null,"whatItDoes":"Crawls any documentation or SaaS website and generates a standards-compliant /llms.txt manifest plus JSON-LD schema bundle for AI agent consumption","exampleAgentPrompt":"Crawl the docs at https://stripe.com/docs and generate a standards-compliant /llms.txt manifest and JSON-LD schema bundle so AI agents can consume Stripe's documentation directly.","exampleUseCases":[{"title":"AI-indexing a SaaS product site","prompt":"Crawl https://docs.linear.app and generate an /llms.txt manifest so my AI agent can reference Linear's documentation without hallucinating feature details."},{"title":"Preparing agent context for internal wiki","prompt":"Take our company docs at https://docs.acme.com and compile a ready-to-use /llms.txt and JSON-LD schema bundle so our support agent can answer questions grounded in real documentation."},{"title":"Bootstrapping LLM context for a new API integration","prompt":"I'm building an agent that needs to understand the Resend email API — can you crawl https://resend.com/docs and produce a standards-compliant /llms.txt manifest I can feed directly into my agent's context?"}],"resultDescription":"Returns a standards-compliant /llms.txt manifest and JSON-LD schema bundle compiled from the crawled website, structured so AI agents and LLMs can directly consume the documentation as grounded context.","failureModes":["Invalid or unreachable URL returns an error with no manifest","Sites with aggressive bot-blocking or CAPTCHAs may result in incomplete crawls","Very large documentation sites may return partial results or time out","Dynamically rendered (JavaScript-heavy) sites may yield incomplete content if crawler cannot execute JS","Malformed URLs without proper scheme (http/https) will fail validation"],"whenToPreferThis":"Choose this endpoint when you need to make any documentation or SaaS website directly consumable by AI agents in the /llms.txt standard format, especially when building agent tooling that requires grounded, up-to-date reference material from external sites. Prefer this over manual documentation ingestion pipelines when you want a single-call solution that handles crawling, structuring, and JSON-LD schema generation together.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-21T07:21:12.533Z","isFirstParty":false,"canonicalSlug":"defi-yield-agentdiet-dev-automated-llms-txt-agent-documentation-bc53bec7"}