{"uid":"cap_A8TUVgAag01UcImjrPCKy","slug":"feedback-theme-multiclass-brier-score-906ae51f","name":"Feedback Theme Multiclass Brier Score","description":"Feedback theme - Multiclass Brier score: Multiclass Brier score for Feedback theme. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded multiclass brier score deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-feedback-theme-brier?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["quality","price","delivery","support"],"type":"string"},"predicted":{"enum":["quality","price","delivery","support"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"quality sample document number 0 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"quality sample document number 1 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"quality sample document number 2 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"price sample document number 0 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"price sample document number 1 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"price sample document number 2 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"delivery sample document number 0 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"delivery sample document number 1 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"delivery sample document number 2 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"support sample document number 0 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"support sample document number 1 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"support sample document number 2 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_40VnRcpNQafw_qRRLHJoa","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes the multiclass Brier score for a feedback theme classifier across up to 200 labelled text records with actual labels, predicted labels, and class probabilities.","exampleAgentPrompt":"Can you compute the multiclass Brier score for my feedback theme classifier? I have 50 labelled records where each has an ID, the text, the actual label (one of quality, price, delivery, or support), the predicted label, and a 4-element probability vector summing to 1.","exampleUseCases":[{"title":"Evaluating customer feedback classifier accuracy","prompt":"I built a feedback classifier that predicts whether a customer review is about quality, price, delivery, or support. I have 120 labelled examples with actual labels, predicted labels, and probability scores for each class — can you compute the multiclass Brier score to see how well-calibrated it is?"},{"title":"Comparing naive-Bayes baseline to new model","prompt":"I want to benchmark my naive-Bayes baseline on 80 feedback records tagged as quality, price, delivery, or support. Each record has the actual label, the predicted label, and 4 class probabilities. Can you run a Brier score evaluation so I can compare it against my improved model?"},{"title":"Validating probability calibration before deployment","prompt":"Before I deploy my feedback theme classifier, I need to check its probability calibration on 200 held-out records labelled with quality, price, delivery, or support categories. Each record has an ID, the original text, the actual and predicted labels, and a 4-class probability array — please calculate the multiclass Brier score."}],"resultDescription":"Returns a single bounded multiclass Brier score value summarising the mean squared difference between predicted class probability vectors and one-hot encoded actual labels across all supplied records, allowing assessment of classifier calibration and probabilistic accuracy for the four feedback themes (quality, price, delivery, support).","failureModes":["More than 200 records submitted — exceeds maximum batch size","Probability vector does not contain exactly 4 elements — violates minItems/maxItems constraint","Individual probability values outside [0, 1] range — validation failure","Invalid or unrecognised label value outside enum (quality, price, delivery, support) — schema rejection","Empty records array submitted — no data to evaluate","Missing required fields (id, text, actual, predicted, probabilities) on any record — schema error"],"whenToPreferThis":"Choose this endpoint when you need a proper probabilistic scoring rule (Brier score) to evaluate a multiclass text classifier over the four feedback themes (quality, price, delivery, support) on a local labelled dataset of up to 200 records, particularly when you want to assess probability calibration rather than just accuracy. Prefer this over accuracy-only metrics when your classifier outputs class probabilities and you need a bounded, interpretable score. Best suited for small-scale offline evaluation workflows without requiring a hosted model or foundation model infrastructure.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-19T19:14:25.278Z","isFirstParty":false,"canonicalSlug":"feedback-theme-multiclass-brier-score-906ae51f"}