{"uid":"cap_V13gDHj-T81mr-jDskZDU","slug":"shopify-intel-agentdiet-dev-web-url-prompt-compressor-with-bm25-500b9e62","name":"Web URL Prompt Compressor with BM25 Budget Control","description":"Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://shopify-intel.agentdiet.dev/v1/prompt-compress)","url":"https://shopify-intel.agentdiet.dev/v1/prompt-compress?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","required":["url"],"properties":{"url":{"type":"string","minLength":1,"description":"Target webpage URL to fetch and distill (or builtin://stripe-docs)"},"html":{"type":"string","description":"Optional raw HTML string to distill directly without fetching"},"mode":{"enum":["markdown","structured","skeleton","budget"],"type":"string","default":"markdown","description":"Distillation mode"},"query":{"type":"string","description":"BM25 focus query when mode=budget"},"max_tokens":{"type":"integer","minimum":20,"description":"Strict token budget ceiling when mode=budget"}}},"responseSchema":{"type":"object","required":["status","roi_proof","data"],"properties":{"data":{"type":"object","description":"Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."},"cache":{"type":"object","properties":{"status":{"enum":["HIT","MISS"],"type":"string"},"cache_key":{"type":"string"},"latency_ms":{"type":"number"}}},"status":{"type":"string","description":"Execution status ('ok')"},"billing":{"type":"object","properties":{"agent_id":{"type":"string"},"payment_method":{"type":"string"},"fee_charged_usd":{"type":"number"}}},"roi_proof":{"type":"object","properties":{"raw_tokens":{"type":"integer"},"tokens_saved":{"type":"integer"},"roi_multiplier":{"type":"number"},"distilled_tokens":{"type":"integer"},"llm_cost_saved_usd":{"type":"number"},"compression_ratio_pct":{"type":"number"}}}}},"example":null,"exampleRequest":null,"tags":[],"displayCostAmount":"0.001","displayCostAsset":"USD","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.001/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.001","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.001","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_Pe1Te3IEXMKjwrX32WkrX","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"0.001","costPer":"request","priority":0,"asset":"0x833589fcd6edb6e08f4c7c32d4f71b54bda02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":"shopify-intel.agentdiet.dev","brandSlug":"shopify-intel-agentdiet-dev-mpp","brandBaseUrl":"https://shopify-intel.agentdiet.dev","brandDocsUrl":null,"whatItDoes":"Fetches a webpage or raw HTML and distills it into compact, agent-ready tokens using configurable extraction modes (markdown, structured, skeleton, or BM25 budget-constrained).","exampleAgentPrompt":"Can you fetch https://stripe.com/docs/payments and distill it into compact markdown, keeping it under 800 tokens and focused on the query 'payment intents'?","exampleUseCases":[{"title":"Compress docs page for RAG pipeline","prompt":"Grab https://docs.openai.com/api-reference and distill it into structured JSON tables so I can feed it into my retrieval pipeline without blowing up my context window."},{"title":"Budget-constrained research extraction","prompt":"Fetch https://en.wikipedia.org/wiki/Transformer_(machine_learning_model) and extract only the content most relevant to 'attention mechanism' — keep it under 500 tokens using budget mode."},{"title":"Skeleton outline of a long article","prompt":"I need a skeleton outline of https://www.paulgraham.com/greatwork.html — just the section headers and key structural points, nothing verbose."}],"resultDescription":"Returns a JSON object with a 'data' field containing the distilled content (markdown text, structured tables/metadata, skeleton outline, or BM25-ranked excerpt depending on mode), plus an 'roi_proof' object showing raw token count, distilled token count, tokens saved, compression ratio percentage, ROI multiplier, and estimated LLM cost saved in USD. Also includes cache status (HIT/MISS) and billing details.","failureModes":["Invalid or unreachable URL returns an error status","HTML too large or malformed may produce poor distillation quality","max_tokens too low (below 20) rejected at schema validation","BM25 budget mode without a query may fall back to generic truncation","Paywalled or JavaScript-heavy pages may return incomplete content","x402 payment failure blocks the request if agent wallet is not funded"],"whenToPreferThis":"Choose this endpoint when an agent needs to ingest a live webpage into a context window that is token-constrained — especially when you want BM25-ranked relevance filtering via the 'budget' mode rather than naive truncation. Prefer it over generic web scrapers when you need token-count guarantees, ROI metrics on compression, and structured output modes (markdown, JSON tables, skeleton). Best fit for LLM pipelines where raw HTML is too large and you need provably compact, query-focused excerpts.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-21T07:20:57.990Z","isFirstParty":false,"canonicalSlug":"shopify-intel-agentdiet-dev-web-url-prompt-compressor-with-bm25-500b9e62"}