{"uid":"cap_IVecMKjMh-tAYwECU5KaK","slug":"training-question-exact-normalised-duplicate-audit-6056e0ca","name":"Training Question Exact Normalised Duplicate Audit","description":"Training question - Exact normalised duplicate audit: Exact normalised duplicate audit for Training question. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded exact normalised duplicate audit deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-training-question-duplicates?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["concept","procedure","example","assessment"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"concept sample document number 0 for this supplied dataset.","actual":"concept"},{"id":"example-0-1","text":"concept sample document number 1 for this supplied dataset.","actual":"concept"},{"id":"example-0-2","text":"concept sample document number 2 for this supplied dataset.","actual":"concept"},{"id":"example-1-0","text":"procedure sample document number 0 for this supplied dataset.","actual":"procedure"},{"id":"example-1-1","text":"procedure sample document number 1 for this supplied dataset.","actual":"procedure"},{"id":"example-1-2","text":"procedure sample document number 2 for this supplied dataset.","actual":"procedure"},{"id":"example-2-0","text":"example sample document number 0 for this supplied dataset.","actual":"example"},{"id":"example-2-1","text":"example sample document number 1 for this supplied dataset.","actual":"example"},{"id":"example-2-2","text":"example sample document number 2 for this supplied dataset.","actual":"example"},{"id":"example-3-0","text":"assessment sample document number 0 for this supplied dataset.","actual":"assessment"},{"id":"example-3-1","text":"assessment sample document number 1 for this supplied dataset.","actual":"assessment"},{"id":"example-3-2","text":"assessment sample document number 2 for this supplied dataset.","actual":"assessment"}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_LyaSrymcM-sA3fSVdHtbx","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Audits up to 200 labelled training question text records to detect exact normalised duplicates within the dataset.","exampleAgentPrompt":"Can you audit my training question dataset for exact normalised duplicates? I have about 150 labelled records, each tagged as concept, procedure, example, or assessment — I want to know which ones are repeated.","exampleUseCases":[{"title":"Pre-training data deduplication check","prompt":"Before I fine-tune my text classifier, can you check these 180 labelled training questions for exact normalised duplicates? Each record has an ID, the question text, and a label of concept, procedure, example, or assessment."},{"title":"Dataset quality audit for EdTech platform","prompt":"I have 120 training questions labelled as concept, procedure, example, or assessment for our learning platform — can you run a duplicate audit on them to make sure there are no repeated questions after normalisation?"},{"title":"Curriculum data cleaning before model training","prompt":"We collected 200 training questions tagged as concept, procedure, example, or assessment and need to clean them up — please audit them for exact normalised duplicates so we can remove redundant entries before training."}],"resultDescription":"A bounded exact normalised duplicate audit report identifying which records among the submitted labelled text entries are exact matches after normalisation, including duplicate pairs or groups and counts, enabling data cleaning before model training.","failureModes":["Fewer than 2 records submitted — minimum input requirement not met","More than 200 records submitted — exceeds maximum item limit","Record missing required fields (id, text, or actual) — schema validation error","Invalid label value outside allowed enum (concept, procedure, example, assessment) — rejected","Record ID exceeds 80 characters — schema violation","Text field exceeds 1000 characters — schema violation","Payment of 0.01 USDC not provided or rejected — 402 response"],"whenToPreferThis":"Use this endpoint when you need a fast, low-cost exact normalised duplicate check on a small-to-medium labelled training question dataset (up to 200 records) before running ML training pipelines. It is purpose-built for training data with categorical labels (concept, procedure, example, assessment) and is ideal for data cleaning workflows where semantic similarity is not required — only exact matches after normalisation.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-12T06:56:53.949Z","isFirstParty":false,"canonicalSlug":"training-question-exact-normalised-duplicate-audit-6056e0ca"}