{"uid":"cap_jBIwcQpsFibxvWp-DAoCO","slug":"audit-tools-ai-actor-evaluator-989b9ea2","name":"audit-tools.ai Actor Evaluator","description":"Evaluate an Apify actor before you use it. Send one actor ID (for example apify/instagram-scraper) and get an evidence-backed quality report: 23 built-in criteria like reliability, 30-day failure rate, advertised-field truth, and cost per usable item, deep-scan criteria measured from live funded runs, or your own rubric in plain English. Use it to audit a scraper, compare actor quality, or pick the best actor. Returns JSON with per-criterion scores, evidence, and a verdict.","url":"https://audit-tools.ai/api/evaluations","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"mode":{"enum":["full"],"type":"string","description":"Full evaluation (all available deep-scan criteria)"},"targets":{"type":"array","items":{"type":"string"},"maxItems":1,"minItems":1,"description":"One Apify actor ID or URL, e.g. apify/instagram-scraper"},"customCriteria":{"type":"array","description":"Optional custom rubric: your own criteria to score the actor against, each with a name and a plain-language description of what to measure"}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"1","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$1/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"1","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"1","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_-XxXmTWfDc4wQt1SwGlkD","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"1","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Evaluates an Apify actor's quality by scoring it against up to 23 built-in and/or custom criteria, returning per-criterion evidence and a verdict.","exampleAgentPrompt":"Run a full audit on the apify/instagram-scraper actor — I want to see reliability scores, 30-day failure rate, whether it actually delivers the advertised fields, and cost per usable item, all backed by evidence.","exampleUseCases":[{"title":"Pre-use actor vetting","prompt":"Before I start using apify/web-scraper in production, can you do a full quality audit on it? I need to see reliability, failure rate, advertised-field accuracy, and cost per usable item."},{"title":"Comparing actors for a project","prompt":"I'm trying to decide between apify/instagram-scraper and social-media-scraper/instagram — can you run a full evaluation on apify/instagram-scraper with custom criteria like 'returns at least 10 posts per profile' and 'handles private profiles gracefully', so I can compare them?"},{"title":"Cost-efficiency check before scaling","prompt":"We're about to scale up our data pipeline using apify/google-search-scraper — run a full audit and specifically tell me what it costs per usable result and how often runs fail."}],"resultDescription":"A JSON object containing per-criterion scores, evidence backing each score, a failure rate over the last 30 days, cost-per-usable-item analysis, advertised-field truth scores, and an overall verdict on actor quality. Optionally includes scores for user-defined custom criteria.","failureModes":["Actor ID not found on Apify — returns error indicating unknown target","Live funded run required for deep-scan fails due to actor timeout or error","Custom criteria descriptions too vague to score reliably — low-confidence scores returned","Actor has insufficient run history for statistical failure-rate calculation","Payment not confirmed — $1 USDC x402 payment required before evaluation proceeds"],"whenToPreferThis":"Choose this endpoint when you need an objective, evidence-backed quality assessment of a specific Apify actor before committing to it in production, when comparing multiple actors for the same task, or when you want to apply a custom rubric beyond the 23 built-in criteria. It is particularly valuable for high-volume scraping pipelines where actor reliability and cost-per-usable-item directly affect operational costs.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-13T18:33:34.900Z","isFirstParty":false}