{"uid":"cap_uif1YDCe_MOI7vQLKiWC1","slug":"language-routing-exact-normalised-duplicate-audit-def902ad","name":"Language Routing — Exact Normalised Duplicate Audit","description":"Language routing - Exact normalised duplicate audit: Exact normalised duplicate audit for Language routing. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded exact normalised duplicate audit deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-language-routing-duplicates?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["english","french","spanish","other"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"english sample document number 0 for this supplied dataset.","actual":"english"},{"id":"example-0-1","text":"english sample document number 1 for this supplied dataset.","actual":"english"},{"id":"example-0-2","text":"english sample document number 2 for this supplied dataset.","actual":"english"},{"id":"example-1-0","text":"french sample document number 0 for this supplied dataset.","actual":"french"},{"id":"example-1-1","text":"french sample document number 1 for this supplied dataset.","actual":"french"},{"id":"example-1-2","text":"french sample document number 2 for this supplied dataset.","actual":"french"},{"id":"example-2-0","text":"spanish sample document number 0 for this supplied dataset.","actual":"spanish"},{"id":"example-2-1","text":"spanish sample document number 1 for this supplied dataset.","actual":"spanish"},{"id":"example-2-2","text":"spanish sample document number 2 for this supplied dataset.","actual":"spanish"},{"id":"example-3-0","text":"other sample document number 0 for this supplied dataset.","actual":"other"},{"id":"example-3-1","text":"other sample document number 1 for this supplied dataset.","actual":"other"},{"id":"example-3-2","text":"other sample document number 2 for this supplied dataset.","actual":"other"}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_rnIb-W1GGhMc7MxALXnVE","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Audits up to 200 labelled text records for exact normalised duplicates within a language-routing (English/French/Spanish/other) dataset.","exampleAgentPrompt":"Can you run an exact normalised duplicate audit on my language routing dataset? I have 150 labelled records — each with an ID, the text, and a language label (english, french, spanish, or other) — and I want to know which ones are duplicates after normalisation.","exampleUseCases":[{"title":"Pre-training data deduplication check","prompt":"Before I train my language router, can you audit these 180 labelled text samples for exact normalised duplicates? Each record has an ID, the text, and a label of english, french, spanish, or other — I need to know if any are repeated."},{"title":"Evaluation dataset integrity audit","prompt":"I'm building an evaluation set for a language classifier and I want to make sure there are no duplicate entries. Can you check these 120 records — they each have an ID, text, and an actual label like english or french — for exact normalised duplicates?"},{"title":"Active learning corpus cleanup","prompt":"We've been collecting labelled sentences for our language routing model and I suspect some got added twice. Can you run a duplicate audit on these 95 records with their IDs, texts, and english/french/spanish/other labels to surface any exact normalised matches?"}],"resultDescription":"A bounded duplicate audit report identifying which records among the submitted labelled text samples are exact normalised duplicates, including the offending record pairs or groups, enabling data cleaning before model training or evaluation.","failureModes":["Fewer than 2 records submitted — minimum input not met","More than 200 records submitted — exceeds maximum batch size","Record missing required fields (id, text, actual) — validation error","Invalid language label outside enum (english, french, spanish, other) — schema rejection","Record ID exceeds 80 character limit — field length violation","Text exceeds 1000 character limit per record — truncation or error","Payment of 0.01 USDC not fulfilled — x402 payment required error"],"whenToPreferThis":"Choose this endpoint when you need a fast, cheap ($0.01 USDC) exact normalised duplicate check on a small batch (up to 200 records) of labelled language-routing text data. It is best suited for data quality audits prior to training or evaluating naive-Bayes or similar lightweight classifiers on English/French/Spanish/other corpora, where you do not need semantic or fuzzy deduplication — only exact normalised matches.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-15T18:47:52.809Z","isFirstParty":false,"canonicalSlug":"language-routing-exact-normalised-duplicate-audit-def902ad"}