{"uid":"cap_Jnj2rREXA1Ft1yBdbXpFG","slug":"sentiment-exact-normalised-duplicate-audit-3e981f3d","name":"Sentiment Exact Normalised Duplicate Audit","description":"Sentiment - Exact normalised duplicate audit: Exact normalised duplicate audit for Sentiment. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded exact normalised duplicate audit deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-sentiment-duplicates?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["positive","neutral","negative"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"positive sample document number 0 for this supplied dataset.","actual":"positive"},{"id":"example-0-1","text":"positive sample document number 1 for this supplied dataset.","actual":"positive"},{"id":"example-0-2","text":"positive sample document number 2 for this supplied dataset.","actual":"positive"},{"id":"example-1-0","text":"neutral sample document number 0 for this supplied dataset.","actual":"neutral"},{"id":"example-1-1","text":"neutral sample document number 1 for this supplied dataset.","actual":"neutral"},{"id":"example-1-2","text":"neutral sample document number 2 for this supplied dataset.","actual":"neutral"},{"id":"example-2-0","text":"negative sample document number 0 for this supplied dataset.","actual":"negative"},{"id":"example-2-1","text":"negative sample document number 1 for this supplied dataset.","actual":"negative"},{"id":"example-2-2","text":"negative sample document number 2 for this supplied dataset.","actual":"negative"}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_IjszekeqRWXr017BZ4JzA","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Identifies exact normalised duplicate text records across a labelled sentiment dataset of up to 200 entries, flagging redundancy issues for dataset quality review.","exampleAgentPrompt":"Can you audit these 50 labelled sentiment records for exact normalised duplicates? I have a mix of positive, neutral, and negative examples and I need to know which ones are redundant before I use the dataset for model evaluation.","exampleUseCases":[{"title":"Pre-training dataset deduplication check","prompt":"I have 150 sentiment-labelled text samples I want to use for training a classifier — can you run an exact normalised duplicate audit on them so I can remove any redundant records before I start?"},{"title":"Benchmark evaluation data integrity audit","prompt":"Before I run model evaluation, can you check my 80 labelled sentiment records for exact normalised duplicates? I need to make sure the test set is clean with no repeated examples skewing the results."},{"title":"Crowdsourced annotation duplicate detection","prompt":"We just collected 200 annotated sentiment labels from crowdworkers — can you audit the dataset for exact normalised duplicates so we can flag records that might have been submitted more than once?"}],"resultDescription":"A structured audit report identifying which of the supplied labelled text records are exact normalised duplicates of one another, including duplicate pair references by record ID, counts, and a summary of dataset redundancy.","failureModes":["Fewer than 2 records supplied — minimum input not met","More than 200 records supplied — exceeds maximum batch size","Record missing required fields (id, text, or actual) — validation error","Invalid sentiment label value outside positive/neutral/negative enum — rejected","Text exceeding 1000 character limit per record — truncation or rejection","Empty text string provided — may produce false duplicate matches","Payment not completed — 402 response, no result returned"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, cost-effective exact normalised duplicate check on a small-to-medium labelled sentiment dataset (up to 200 records) without invoking a heavy model or foundation model pipeline. Ideal for pre-training data hygiene, evaluation set integrity checks, or annotation quality audits where exact string-level deduplication (after normalisation) is sufficient and probabilistic or semantic deduplication is not required.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-12T00:54:23.615Z","isFirstParty":false,"canonicalSlug":"sentiment-exact-normalised-duplicate-audit-3e981f3d"}