{"uid":"cap_ctG60JZw0fbCf-QGZRYq3","slug":"llms-txt-fetch-bulk-53f6437a","name":"llms-txt-fetch-bulk","description":"Bulk llms txt fetch: up to 20 domains in one call, processed concurrently, results returned in input order with a per-item error field and a count of failures. Same answer per item as the single /site/llms-txt endpoint (llms). Batch enrichment for agents that hold a list. $0.01 per batch.","url":"https://intel.rallylive.ca/bulk/site/llms-txt","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","properties":{}}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.1","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.1/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.1","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.1","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_jCxF1ZLkBjP-ZUtCVXj88","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.1","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches llms.txt files for up to 20 domains concurrently in a single API call, returning ordered results with per-item error reporting.","exampleAgentPrompt":"Can you fetch the llms.txt files for all of these domains at once: openai.com, anthropic.com, mistral.ai, cohere.com, and huggingface.co? I want to see their AI context files in one batch call.","exampleUseCases":[{"title":"AI vendor landscape research","prompt":"I have a list of 15 AI tool vendors — openai.com, cohere.com, mistral.ai, together.ai, fireworks.ai, groq.com, deepmind.com, stability.ai, midjourney.com, runway.ml, elevenlabs.io, replicate.com, anyscale.com, modal.com, and lambda.ai — can you grab all their llms.txt files in one shot so I can compare how they describe themselves to AI agents?"},{"title":"Bulk partner site enrichment","prompt":"We're onboarding 12 new partner sites and I need to check if they all publish llms.txt files. Can you batch-fetch the llms.txt for example1.com, example2.com, example3.com, example4.com, example5.com, example6.com, example7.com, example8.com, example9.com, example10.com, example11.com, and example12.com and tell me which ones are missing?"},{"title":"Competitive intelligence crawl","prompt":"Pull the llms.txt files for our top 10 competitors — salesforce.com, hubspot.com, zendesk.com, intercom.com, freshdesk.com, drift.com, gorgias.com, kustomer.com, gladly.com, and front.com — all at once so I can analyze how each of them is positioning their AI capabilities."}],"resultDescription":"An ordered array of results matching the input domain list, where each item contains the fetched llms.txt content (same structure as the single-domain endpoint) plus a per-item error field indicating fetch failures. A top-level failure count summarizes how many domains could not be fetched.","failureModes":["Domain unreachable or times out — per-item error field populated, rest of batch still returns","llms.txt file not found at domain — item returns not-found error","Exceeding 20-domain limit per call — request rejected","Malformed domain input — validation error returned","All domains fail — full failure count returned with empty results"],"whenToPreferThis":"Use this endpoint when you have a list of 2–20 domains and need their llms.txt files in a single API call rather than making sequential single-domain requests. It is ideal for batch enrichment pipelines, competitive intelligence crawls, or onboarding workflows where you need to check multiple sites concurrently. Prefer the single-domain endpoint for one-off lookups where simplicity matters more than throughput.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-14T06:55:25.837Z","isFirstParty":false}