{"uid":"cap_hT0KJi_ZCfrUcOwqaPq9B","slug":"feedback-theme-label-and-prediction-audit-aa322b03","name":"Feedback Theme Label and Prediction Audit","description":"Feedback theme - Label and prediction audit: Label and prediction audit for Feedback theme. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded label and prediction audit deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-feedback-theme-label-audit?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["quality","price","delivery","support"],"type":"string"},"predicted":{"enum":["quality","price","delivery","support"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"quality sample document number 0 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"quality sample document number 1 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"quality sample document number 2 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"price sample document number 0 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"price sample document number 1 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"price sample document number 2 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"delivery sample document number 0 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"delivery sample document number 1 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"delivery sample document number 2 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"support sample document number 0 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"support sample document number 1 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"support sample document number 2 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_hCQqt6scsxcRxTBDf6vYi","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Audits up to 200 labelled text records for a 4-class feedback theme classifier (quality, price, delivery, support), computing evaluation metrics from supplied actual and predicted labels with class probabilities.","exampleAgentPrompt":"Can you audit my feedback theme classifier results? I have 150 records where each one has the actual label (quality, price, delivery, or support), the predicted label, and four class probabilities — run a label and prediction audit on them and tell me how the model is performing.","exampleUseCases":[{"title":"Post-deployment classifier accuracy check","prompt":"We just deployed a feedback theme model and I want to audit its predictions on 120 labelled records — actual labels are quality, price, delivery, or support, and I have the predicted labels plus probability scores for each class. Can you run a full prediction audit and tell me where it's going wrong?"},{"title":"Comparing model outputs before release","prompt":"I have 80 customer feedback records with ground-truth labels and two sets of predictions from our model candidates. Start with the first set — actual and predicted labels are one of quality, price, delivery, or support, and I have four class probabilities per record. Run a label audit so I can see which performs better."},{"title":"Diagnosing low-confidence misclassifications","prompt":"My feedback classifier seems to be confusing 'delivery' and 'support' categories. I've got 200 labelled records with actual labels, predicted labels, and four-element probability arrays for each. Can you do a prediction audit so I can see the misclassification patterns and probability calibration?"}],"resultDescription":"A bounded label and prediction audit deliverable covering the supplied records: includes classification evaluation metrics (such as per-class accuracy, confusion breakdown, and probability-based assessments) computed locally against the supplied actual and predicted labels using small naive-Bayes baselines. No hosted or foundation model training is performed.","failureModes":["More than 200 records submitted — batch size limit exceeded","Probabilities array does not contain exactly 4 elements per record","Label values outside the allowed enum (quality, price, delivery, support)","Record ID missing or exceeds 80-character limit","Malformed JSON body or missing required fields causing rejection","Text field exceeds 1000-character limit per record"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, low-cost ($0.01 USDC) audit of a pre-existing 4-class feedback theme classifier — specifically when you already have predicted labels and class probabilities and want evaluation metrics computed against ground truth, without needing to train or host a model. It is ideal for quick post-deployment validation, regression checks, or benchmarking on up to 200 records where the classes are quality, price, delivery, and support.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-19T19:04:01.286Z","isFirstParty":false,"canonicalSlug":"feedback-theme-label-and-prediction-audit-aa322b03"}