{"uid":"cap_Y8aA8LaoXyDUtlW4GLbBc","slug":"market2000-xyz-crawl-to-refer-ratio-6bc7dfee","name":"market2000.xyz Crawl-to-Refer Ratio","description":"Crawl-to-refer — what each AI company takes from a site versus what it sends back.\n\nPer company: pages crawled, visitors referred, and the ratio between them, measured at an origin's own door. Every publisher wants this number for their own site and cannot compute it without being the origin being crawled.\n\nHOW TO CALL:\n  GET /api/demand/crawl-to-refer?days=30\n\nPARAMETERS:\n  days — lookback window, 1-90 (default 30)\n\nRESPONSE: by_company[] with crawls, referrals and the ratio, plus an explicit caveat on mixed-use crawlers whose referrals cannot be attributed to search or AI.\n\nPRICING: $0.10 per call.","url":"https://market2000.xyz/api/demand/crawl-to-refer","method":"GET","headers":{},"bodySchema":{"type":"object","$schema":"https://json-schema.org/draft/2020-12/schema","required":["input"],"properties":{"input":{"type":"object","required":["type","method","queryParams"],"properties":{"type":{"type":"string","const":"http"},"method":{"enum":["GET","HEAD","DELETE"],"type":"string"},"queryParams":{"type":"object","properties":{}}}},"output":{"type":"object","required":["type"],"properties":{"type":{"type":"string"},"example":{"type":"object"}}}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.1","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$5/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"5","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"5","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_UdjexQzqhoN-Jns_jk39x","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"5","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Returns per-AI-company statistics on pages crawled versus visitors referred, with the crawl-to-referral ratio, over a configurable lookback window.","exampleAgentPrompt":"Show me which AI companies crawled my site the most versus how much referral traffic they actually sent back over the last 30 days, and give me the crawl-to-refer ratio for each one.","exampleUseCases":[{"title":"Publisher auditing AI crawler value","prompt":"I want to know if the AI crawlers indexing my site are sending me any visitors in return — can you pull the crawl-to-refer ratio for each AI company over the past 30 days so I can see who are the net takers?"},{"title":"Monitoring monthly crawler equity trends","prompt":"Pull the crawl-to-refer data for the last 7 days and compare it to the last 30-day window so I can see if any AI company's ratio is getting better or worse over time."},{"title":"Evaluating whether to block specific AI bots","prompt":"I'm deciding whether to block certain AI crawlers in my robots.txt — can you show me the crawl-to-refer ratios for all AI companies over the last 90 days so I can see which ones give nothing back?"}],"resultDescription":"An array (by_company) where each entry contains the AI company name, total pages crawled, total visitors referred, and the numeric crawl-to-refer ratio. Also includes an explicit caveat flagging mixed-use crawlers (e.g. those used for both search and AI training) where referral attribution to AI vs search is ambiguous.","failureModes":["days parameter out of range (must be 1-90) returns a validation error","origin has insufficient crawl data for the requested window, returning sparse or empty by_company array","mixed-use crawler referrals may be unattributable, flagged with a caveat rather than an error","payment failure (x402) if USDC payment is not attached or insufficient","rate limiting if called too frequently"],"whenToPreferThis":"Use this endpoint when you need to understand the reciprocity relationship between AI crawlers and referral traffic at the origin level — data that only the origin can observe. Prefer this over generic SEO tools when the specific question is about AI company crawl behavior versus traffic returned, rather than overall SEO performance or keyword ranking.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-15T13:00:28.612Z","isFirstParty":false}