{"uid":"cap_kqZBCEoOL0gdJ1U03Ntwp","slug":"trollbridge-scrape-web-page-to-clean-text-0084e993","name":"TrollBridge /scrape — Web Page to Clean Text","description":"The insurance booth for AI agents, with Mini's Agent Supply Store on the side of the road. One hundred checkpoints: pre-transaction safety lanes (honeypot, approval-risk, rug-score, receipt-check, tx-dryrun, permit-scan, airdrop-verdict, deployer-history, wallet-watch, secret-scan at $0.02 USDC per call; the protection tier — /contract-check, /approval-screen, /tx-plain-english, /honeypot-check, /tx-simulate, /redteam, /skill-scan, /verdict, /egress-audit, /tool-gate, /airlock, /repo-scan, /prove, /task-scope — at $0.10; the one-call /shield don't-get-rugged screen at $0.25; the full /preflight bundle at $0.05), bounty intel (bounties, fresh, verdicts, deadlines, sweepstakes, opportunities) at $0.02 USDC per call, trader intel (/prices and /quant at $0.02; /enrich and /token-check at $0.05; /contract-check and /honeypot-check at $0.10; /sec-facts at $0.05), market intel (/markets and /search at $0.05; /grants at $0.02), DeFi intel (/yields and /new-pairs at $0.05; /gas and /defi at $0.02), AI intel (/models at $0.02), agent-ops intel (/prompt-cost, /model-picks, /rpc-speed, /terms-tldr, /scrape, /gigs, /retry-verify, /idempotency, /verify-independent at $0.02; /site-watch, /wallet-check, /code-run, /regulatory-pack, /sage, /cron-watch, /caveat-check, /tripwire, /escrow, /trust, /bridge-fees, /dao-votes, /dev-activity, /dex-arb, /dydx-perps, /funding-rates, /gas-predict, /hack-tracker, /long-short-ratio, /lp-yields, /mev-scan, /open-interest, /perp-basis, /polymarket-odds, /rwa-watch, /sentiment, /stablecoin-flows, /tokenomics, /top-movers, /whale-watch, and /yield-stable at $0.05; /approval-screen, /tx-plain-english, /tx-simulate, and /task-scope at $0.10; /scam-scan deep scan at $5.00 or 30-day subscription at $30.00), supply store (/road-pack combo meal at $0.05; curated datasets, the /audit-prep pre-audit review, and the /prove-state symbolic-execution run at $1.00; the /audit AI-agent audit at $25.00). Every lane answers before money moves — heuristic verdicts, not audits. Don't get rugged.","url":"https://mini-tollbooth.onrender.com/scrape?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET"],"type":"string"},"queryParams":{"type":"object","required":["url"],"properties":{"url":{"type":"string","description":"Public page URL to fetch and convert to clean text."},"crawl":{"type":"string","description":"Set to 1 to follow same-origin links (up to max_pages)."},"max_pages":{"type":"string","description":"Max pages when crawling (default 3, max 10)."}}}},"additionalProperties":false},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":{"type":"json","example":{"url":"https://example.com","lane":"/scrape","text":"…","links":["https://example.com"],"title":"Example Domain","word_count":29,"description":"Page-to-text scraper ($0.02) — fetch any public page and get clean readable text, title, and links as JSON. Optional ?crawl=1 follows same-origin links (up to 10 pages). Honest fetch, not a JS renderer."}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.02","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.02/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.02","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.02","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_etmfnZndAji2gvnROBB2D","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.02","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Fetches any public web page and returns clean readable text, title, links, and word count as JSON; optionally crawls same-origin links.","exampleAgentPrompt":"Can you fetch the page at https://example.com/blog/intro and give me the clean readable text and all the links on it?","exampleUseCases":[{"title":"Research article content extraction","prompt":"Go to https://news.ycombinator.com and scrape the page — I want the clean text and all the links so I can see what's trending today."},{"title":"Multi-page site crawl for context","prompt":"Fetch https://docs.someprotocol.xyz and follow same-origin links up to 5 pages so I can read the full documentation as plain text."},{"title":"Competitor page monitoring","prompt":"Grab the text from https://competitor.io/pricing so I can see what their current pricing page says without opening a browser."}],"resultDescription":"A JSON object containing the fetched page URL, the lane identifier (/scrape), clean readable plain text of the page, an array of discovered links, the page title, word count, and a short description. When crawl=1 is set, multiple pages' content is aggregated up to the max_pages limit.","failureModes":["URL is not publicly accessible or requires authentication — returns error or empty text","JavaScript-rendered pages return incomplete content since this is not a JS renderer","Rate limits or network timeouts on the target server may cause fetch failures","Invalid or malformed URL input returns an error response","Pages with paywalls or bot-blocking return partial or no content"],"whenToPreferThis":"Choose this endpoint when you need fast, honest plain-text extraction from a public URL without JavaScript rendering. It is cost-effective at $0.02 USDC per call and supports optional same-origin link crawling. Prefer it over browser-based scrapers when the target page does not require JS execution, and over general-purpose search APIs when you already have a specific URL to fetch.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-12T18:45:11.545Z","isFirstParty":false,"canonicalSlug":"trollbridge-scrape-web-page-to-clean-text-0084e993"}