{"uid":"cap_XG-aH34PzFjqkij7vj_XH","slug":"kihustle-advanced-robots-txt-generator-facc2b36","name":"KiHustle Advanced Robots.txt Generator","description":"Kostenlose Guides, Solo-Playbooks und Artikel zu KI, Automation und Side Hustles — für Menschen, die mit echten Systemen online Einkommen aufbauen wollen. Transparent finanziert über faire Affiliate-Links.","url":"https://kihustle.tech/bot-bazaar/api/v1/robots-txt-generator-advanced","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"text":{"type":"string"}}},"responseSchema":{"type":"json","example":{"result":"processed","status":"success"}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.002","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.002/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_qmMZM2AaP5WHKNN2O1CMj","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.002","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Generates an advanced robots.txt file based on provided text input, controlling crawler and bot access rules for a website.","exampleAgentPrompt":"Generate an advanced robots.txt file for my site that allows Googlebot and Bingbot full access, blocks all AI training crawlers like GPTBot and CCBot, disallows the /admin and /private directories for everyone, and includes a sitemap reference to https://mysite.com/sitemap.xml.","exampleUseCases":[{"title":"Block AI crawlers from a content site","prompt":"Create a robots.txt for my blog that blocks GPTBot, CCBot, and all AI training crawlers from indexing any content, while still allowing Google and Bing full access to everything."},{"title":"Protect private directories on a SaaS app","prompt":"Generate an advanced robots.txt that disallows all bots from accessing /api/, /admin/, and /user-data/ on my SaaS platform, but lets search engines crawl the public marketing pages freely."},{"title":"SEO-optimized robots.txt for an e-commerce store","prompt":"Make me a robots.txt for my online store that allows Googlebot and Bingbot to crawl product pages and the homepage, blocks duplicate parameter URLs like ?sort= and ?filter=, and points to my sitemap at https://mystore.com/sitemap.xml."}],"resultDescription":"Returns a JSON object with a 'result' field containing the generated robots.txt content as a string, along with a 'status' field indicating success. The robots.txt output includes user-agent directives, allow/disallow rules, and any other specified crawler configuration.","failureModes":["Empty or missing 'text' input field returns a generic or empty robots.txt","Malformed JSON body returns a 400-level error","Ambiguous or insufficient instructions may produce generic boilerplate output","Service downtime or payment failure returns a 402 or 5xx error","Very long or complex input text may be truncated or processed incorrectly"],"whenToPreferThis":"Choose this endpoint when you need to programmatically generate a robots.txt file on demand, especially with advanced or nuanced rules — such as selectively blocking AI crawlers, protecting specific paths, or combining multiple user-agent directives. It is particularly useful for developers automating site setup pipelines, SEO tools generating per-site configurations, or agents helping users configure crawler access without manually writing robots exclusion syntax.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-15T13:18:13.112Z","isFirstParty":false}