{"uid":"cap_gIqV-TsXbAoFEfg2vda-m","slug":"task-type-training-evaluation-text-overlap-checker-8a199b1d","name":"Task Type Training-Evaluation Text Overlap Checker","description":"Task type - Training evaluation text overlap: Training evaluation text overlap for Task type. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded training evaluation text overlap deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-task-type-leakage?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["research","writing","analysis","implementation"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"research sample document number 0 for this supplied dataset.","actual":"research"},{"id":"example-0-1","text":"research sample document number 1 for this supplied dataset.","actual":"research"},{"id":"example-0-2","text":"research sample document number 2 for this supplied dataset.","actual":"research"},{"id":"example-1-0","text":"writing sample document number 0 for this supplied dataset.","actual":"writing"},{"id":"example-1-1","text":"writing sample document number 1 for this supplied dataset.","actual":"writing"},{"id":"example-1-2","text":"writing sample document number 2 for this supplied dataset.","actual":"writing"},{"id":"example-2-0","text":"analysis sample document number 0 for this supplied dataset.","actual":"analysis"},{"id":"example-2-1","text":"analysis sample document number 1 for this supplied dataset.","actual":"analysis"},{"id":"example-2-2","text":"analysis sample document number 2 for this supplied dataset.","actual":"analysis"},{"id":"example-3-0","text":"implementation sample document number 0 for this supplied dataset.","actual":"implementation"},{"id":"example-3-1","text":"implementation sample document number 1 for this supplied dataset.","actual":"implementation"},{"id":"example-3-2","text":"implementation sample document number 2 for this supplied dataset.","actual":"implementation"}],"maxItems":200,"minItems":2},"evaluation_texts":{"type":"array","items":{"type":"string","default":"","maxLength":1000},"default":["research sample document number 0 for this supplied dataset.","A separate supplied document."],"maxItems":200,"minItems":1}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_A_jafY51x3-RnHiTzWg7Y","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Detects text overlap between training records and evaluation texts for task-type classification (research/writing/analysis/implementation) using local naive-Bayes baseline tools.","exampleAgentPrompt":"Check whether any of my evaluation texts overlap with my labelled training records — I have 12 training examples across research, writing, analysis, and implementation categories, and 2 evaluation texts I want to validate against them for data leakage.","exampleUseCases":[{"title":"Pre-training data leakage audit","prompt":"Before I train my task-type classifier, can you check if any of my evaluation texts appear in or overlap with my labelled training records? Here are my 50 labelled samples tagged as research, writing, analysis, or implementation, plus the 10 held-out evaluation texts I want to test with."},{"title":"NLP pipeline contamination check","prompt":"I want to make sure my eval set is clean — can you detect any text overlap between these 80 labelled training documents and my 15 evaluation texts? The training records are tagged with task types like research and implementation."},{"title":"Classifier benchmark integrity validation","prompt":"I'm benchmarking a task-type classifier and need to confirm there's no contamination — can you run a text overlap check between my 120 labelled training records (research, writing, analysis, implementation) and these 20 benchmark evaluation texts?"}],"resultDescription":"A bounded deliverable reporting text overlap between the supplied labelled training records and evaluation texts, identifying which records and evaluation texts share overlapping content — quantifying potential data leakage risk for the task-type classification task across research, writing, analysis, and implementation categories.","failureModes":["Fewer than 2 training records provided — minimum input not met","More than 200 training records or 200 evaluation texts submitted — exceeds maximum item limits","Record text exceeds 1000 character limit — truncation or rejection","Missing required fields (id, text, actual) in record objects","Invalid task type label outside enum (research, writing, analysis, implementation)","Payment not provided or insufficient — x402 payment required at $0.01 USDC"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, affordable ($0.01) check for text leakage between training and evaluation datasets for a 4-class task-type classifier (research/writing/analysis/implementation) without requiring a hosted model or cloud ML infrastructure. Ideal for small datasets up to 200 records where local naive-Bayes baseline tools are sufficient and cost matters.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-12T00:45:23.506Z","isFirstParty":false,"canonicalSlug":"task-type-training-evaluation-text-overlap-checker-8a199b1d"}