{"uid":"cap_3tfxeIxefTcCrIzPx3PbL","slug":"hn-pulse-agentdiet-dev-automated-llms-txt-agent-documentation-context-0fd70137","name":"Automated /llms.txt & Agent Documentation Context Compiler","description":"Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle. (Live x402 v2, IETF MPP & MCP endpoint at https://hn-pulse.agentdiet.dev/v1/llms-txt-compiler)","url":"https://hn-pulse.agentdiet.dev/v1/llms-txt-compiler?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","required":["url"],"properties":{"url":{"type":"string","minLength":1,"description":"Website URL to crawl and generate a ready-to-consume /llms.txt manifest for"}}},"responseSchema":{"type":"object"},"example":null,"exampleRequest":null,"tags":[],"displayCostAmount":"0.015","displayCostAsset":"USD","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.015/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.015","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.015","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_Me1YtZvsQdiHgttwpSmQJ","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"0.015","costPer":"request","priority":0,"asset":"0x833589fcd6edb6e08f4c7c32d4f71b54bda02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":"hn-pulse.agentdiet.dev","brandSlug":"hn-pulse-agentdiet-dev-mpp","brandBaseUrl":"https://hn-pulse.agentdiet.dev","brandDocsUrl":null,"whatItDoes":"Crawls a given website URL and generates a standards-compliant /llms.txt manifest plus a JSON-LD schema bundle for AI agent consumption","exampleAgentPrompt":"Crawl https://docs.stripe.com and generate a standards-compliant /llms.txt manifest and JSON-LD schema bundle so AI agents can easily understand and consume Stripe's documentation.","exampleUseCases":[{"title":"Make SaaS docs AI-agent readable","prompt":"Crawl https://docs.notion.so and compile a ready-to-use /llms.txt manifest and JSON-LD schema bundle so that AI agents can properly navigate and understand Notion's documentation."},{"title":"Prepare open-source project for LLM discovery","prompt":"I want my open-source library's docs at https://fastapi.tiangolo.com to be discoverable by LLMs — can you crawl it and generate an llms.txt manifest and JSON-LD schema for me?"},{"title":"Audit competitor's agent context file","prompt":"Crawl https://platform.openai.com/docs and generate an llms.txt manifest so I can see what an AI-agent-readable version of their documentation looks like."}],"resultDescription":"Returns a standards-compliant /llms.txt manifest file and a JSON-LD schema bundle derived from crawling the target website, structured for direct consumption by AI agents and LLM-based systems.","failureModes":["Invalid or unreachable URL returns an error with no manifest produced","URL points to a site that blocks crawlers, resulting in incomplete or empty manifest","Extremely large documentation sites may produce truncated output","Payment failure (HTTP 402) if x402 USDC payment is not properly submitted","Malformed or non-documentation sites may yield low-quality or sparse manifests"],"whenToPreferThis":"Choose this endpoint when you need to programmatically generate a standards-compliant /llms.txt manifest and JSON-LD schema bundle from any existing website or documentation portal, especially for making SaaS products or developer docs accessible to AI agents. Prefer this over manual authoring when you need automated, repeatable generation from a live URL.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-21T07:23:21.535Z","isFirstParty":false,"canonicalSlug":"hn-pulse-agentdiet-dev-automated-llms-txt-agent-documentation-context-1d919a40"}