{"uid":"cap_bvTU5bPl5JesvdO_IAxYR","slug":"github-audit-agentdiet-dev-automated-llms-txt-agent-documentation-8845b62d","name":"Automated /llms.txt & Agent Documentation Context Compiler","description":"Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle. (Live x402 v2, IETF MPP & MCP endpoint at https://github-audit.agentdiet.dev/v1/llms-txt-compiler)","url":"https://github-audit.agentdiet.dev/v1/llms-txt-compiler?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","required":["url"],"properties":{"url":{"type":"string","minLength":1,"description":"Website URL to crawl and generate a ready-to-consume /llms.txt manifest for"}}},"responseSchema":{"type":"object"},"example":null,"exampleRequest":null,"tags":[],"displayCostAmount":"0.01","displayCostAsset":"USD","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.015/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.015","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.015","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_MusFSzcKlo4mUOjQIRydn","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"0.015","costPer":"request","priority":0,"asset":"0x833589fcd6edb6e08f4c7c32d4f71b54bda02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":"github-audit.agentdiet.dev","brandSlug":"github-audit-agentdiet-dev-mpp","brandBaseUrl":"https://github-audit.agentdiet.dev","brandDocsUrl":null,"whatItDoes":"Crawls any documentation or SaaS website and generates a standards-compliant /llms.txt manifest plus JSON-LD schema bundle for AI agent consumption","exampleAgentPrompt":"Can you crawl https://docs.stripe.com and generate a standards-compliant /llms.txt manifest and JSON-LD schema bundle so AI agents can understand Stripe's documentation?","exampleUseCases":[{"title":"Make SaaS docs AI-agent-readable","prompt":"Crawl https://docs.notion.so and compile a proper /llms.txt manifest for it so my AI agents can reference Notion's documentation without hallucinating."},{"title":"Bootstrap agent context for new API","prompt":"I'm building an agent that needs to understand our product docs at https://docs.mycompany.com — can you generate the llms.txt manifest and JSON-LD schema bundle from that site?"},{"title":"Audit competitor documentation structure","prompt":"Crawl https://platform.openai.com/docs and generate an /llms.txt manifest so I can see how their documentation is structured and what an AI agent would see when consuming it."}],"resultDescription":"Returns a standards-compliant /llms.txt manifest and a JSON-LD schema bundle compiled from the crawled website, structured for direct consumption by AI agents and LLMs. The output includes organized documentation context, section links, and semantic metadata extracted from the target site.","failureModes":["Invalid or unreachable URL returns an error with crawl failure details","Password-protected or bot-blocked sites may return empty or partial results","Very large documentation sites may produce truncated manifests","Sites with heavy JavaScript rendering may yield incomplete content extraction","Malformed URLs result in a validation error"],"whenToPreferThis":"Choose this endpoint when you need to programmatically generate an /llms.txt manifest for any website without manually authoring it — especially useful for onboarding a new documentation site into an agent workflow, enabling AI agent discovery of third-party APIs, or creating machine-readable context bundles from existing SaaS documentation sites. Prefer this over manual llms.txt authoring or generic web scrapers when you need standards-compliant, agent-optimized output.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-21T12:30:02.584Z","isFirstParty":false,"canonicalSlug":"github-audit-agentdiet-dev-automated-llms-txt-agent-documentation-c5bfe1e0"}