{"uid":"cap_JGxiMkkvbVoIg4UP6dE-7","slug":"text-chunker-8d34a92d","name":"text-chunker","description":"Page to RAG chunks: extracts the main content and splits it into overlapping chunks of about 400 words (roughly 500 tokens) on paragraph and sentence boundaries, each with its index, word count and the nearest heading. Ready for embedding pipelines. $0.01 per page.","url":"https://intel.rallylive.ca/page/chunks","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","properties":{}}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_2n-6s6HYg9OOYS-hTQHaP","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches a web page, extracts its main content, and splits it into overlapping ~400-word RAG-ready chunks with metadata (index, word count, nearest heading) for embedding pipelines.","exampleAgentPrompt":"Chunk the page at https://example.com/blog/ai-trends into overlapping ~400-word segments for my RAG pipeline, and include the nearest heading and word count for each chunk.","exampleUseCases":[{"title":"Blog post ingestion for RAG","prompt":"Take this article at https://docs.mysite.com/overview and break it into overlapping ~400-word chunks with headings so I can embed them into my vector store."},{"title":"Knowledge base chunking pipeline","prompt":"I'm building a semantic search system — can you chunk the page at https://en.wikipedia.org/wiki/Machine_learning into embedding-ready segments, each with its index and nearest section heading?"},{"title":"Competitor content analysis prep","prompt":"Fetch https://competitor.com/product-page and split the main content into ~500-token overlapping chunks with word counts so I can run them through my embedding model."}],"resultDescription":"Returns a list of overlapping text chunks derived from the page's main content, each annotated with its sequential index, word count, and the nearest heading found in the document. Chunks are approximately 400 words (~500 tokens) and split on paragraph and sentence boundaries, making them directly usable as inputs to embedding models and vector databases.","failureModes":["URL is inaccessible or returns non-200 status — endpoint may return an error or empty chunk list","Page has no extractable main content (e.g. heavily JavaScript-rendered SPA) — chunks may be sparse or missing","Page is extremely short — may return only one chunk or fewer than expected","Network timeout fetching the remote URL — endpoint returns a timeout error","Malformed or missing URL parameter — returns validation error"],"whenToPreferThis":"Choose this endpoint when you need web page content pre-processed into RAG-ready overlapping chunks with paragraph/sentence-aware splitting and heading metadata attached. It is ideal for embedding pipelines, vector database ingestion, or semantic search indexing where consistent ~400-word segments with contextual heading labels are needed. Prefer it over raw HTML scrapers when you want extraction + chunking in a single paid step without building your own text segmentation logic.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-14T13:03:50.212Z","isFirstParty":false}