{"uid":"cap_iR-fy6SAfx9WUHdkBrc4K","slug":"issue-kind-training-evaluation-text-overlap-detector-2bf34d8e","name":"Issue Kind – Training/Evaluation Text Overlap Detector","description":"Issue kind - Training evaluation text overlap: Training evaluation text overlap for Issue kind. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded training evaluation text overlap deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-issue-kind-leakage?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["bug","request","question","other"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"bug sample document number 0 for this supplied dataset.","actual":"bug"},{"id":"example-0-1","text":"bug sample document number 1 for this supplied dataset.","actual":"bug"},{"id":"example-0-2","text":"bug sample document number 2 for this supplied dataset.","actual":"bug"},{"id":"example-1-0","text":"request sample document number 0 for this supplied dataset.","actual":"request"},{"id":"example-1-1","text":"request sample document number 1 for this supplied dataset.","actual":"request"},{"id":"example-1-2","text":"request sample document number 2 for this supplied dataset.","actual":"request"},{"id":"example-2-0","text":"question sample document number 0 for this supplied dataset.","actual":"question"},{"id":"example-2-1","text":"question sample document number 1 for this supplied dataset.","actual":"question"},{"id":"example-2-2","text":"question sample document number 2 for this supplied dataset.","actual":"question"},{"id":"example-3-0","text":"other sample document number 0 for this supplied dataset.","actual":"other"},{"id":"example-3-1","text":"other sample document number 1 for this supplied dataset.","actual":"other"},{"id":"example-3-2","text":"other sample document number 2 for this supplied dataset.","actual":"other"}],"maxItems":200,"minItems":2},"evaluation_texts":{"type":"array","items":{"type":"string","default":"","maxLength":1000},"default":["bug sample document number 0 for this supplied dataset.","A separate supplied document."],"maxItems":200,"minItems":1}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_3BV1NnV6y0l-EwN4PEQk6","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Detects text overlap between training and evaluation sets for issue-kind classification (bug/request/question/other) using a local naive-Bayes baseline.","exampleAgentPrompt":"Check whether any of my labelled issue records overlap with my evaluation texts — here are 12 training records labelled as bug, request, question, or other, and 2 evaluation documents I want to test against.","exampleUseCases":[{"title":"Support ticket classifier data audit","prompt":"I have a set of labelled support tickets — some marked as bug, request, question, or other — and a separate list of evaluation texts. Can you check if any of the training texts appear in the evaluation set so I know my classifier isn't cheating?"},{"title":"NLP dataset contamination check before model release","prompt":"Before I publish my issue-kind classification dataset, I want to make sure there's no text leakage between the 150 training records and the 50 evaluation documents I'm using. Can you run a training-evaluation text overlap check on them?"},{"title":"GitHub issue triage model validation","prompt":"I trained a naive Bayes model to sort GitHub issues into bugs, feature requests, questions, and other categories. Can you check my training records and evaluation texts for any overlapping content so I can trust my accuracy numbers?"}],"resultDescription":"A bounded deliverable reporting text overlap between the supplied labelled training records and the evaluation texts, including identified overlapping entries and leakage metrics derived from a local naive-Bayes baseline analysis.","failureModes":["Fewer than 2 records supplied — validation error","More than 200 records or evaluation texts supplied — rejected with maxItems error","Record missing required 'id', 'text', or 'actual' field — schema validation failure","Invalid label value outside bug/request/question/other enum — rejected","Text exceeding 1000 characters per record — truncation or rejection","Empty evaluation_texts array — validation error"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, local assessment of training-evaluation text overlap for an issue-kind classifier (bug/request/question/other) without requiring a hosted model or foundation-model training. Ideal for small datasets up to 200 records where data leakage detection is the primary concern and cost sensitivity matters ($0.01 per call).","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-24T12:58:23.705Z","isFirstParty":false,"canonicalSlug":"issue-kind-training-evaluation-text-overlap-detector-2bf34d8e"}