{"uid":"cap_Ol94sYbJA82IGob3RKASt","slug":"feedback-theme-confidence-calibration-bins-011125c3","name":"Feedback Theme Confidence Calibration Bins","description":"Feedback theme - Confidence calibration bins: Confidence calibration bins for Feedback theme. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded confidence calibration bins deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-feedback-theme-calibration?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["quality","price","delivery","support"],"type":"string"},"predicted":{"enum":["quality","price","delivery","support"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"quality sample document number 0 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"quality sample document number 1 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"quality sample document number 2 for this supplied dataset.","actual":"quality","predicted":"quality","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"price sample document number 0 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"price sample document number 1 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"price sample document number 2 for this supplied dataset.","actual":"price","predicted":"price","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"delivery sample document number 0 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"delivery sample document number 1 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"delivery sample document number 2 for this supplied dataset.","actual":"delivery","predicted":"delivery","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"support sample document number 0 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"support sample document number 1 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"support sample document number 2 for this supplied dataset.","actual":"support","predicted":"support","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_gUYv-W1WrF0W-B8POsnGc","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes confidence calibration bins for a naive-Bayes feedback theme classifier across quality, price, delivery, and support categories using up to 200 labelled text records.","exampleAgentPrompt":"Can you compute confidence calibration bins for my feedback theme classifier? I have 120 labelled records with actual and predicted labels across quality, price, delivery, and support categories, plus the 4-class probability scores for each — I want to see how well the model's confidence scores are actually calibrated.","exampleUseCases":[{"title":"Evaluating feedback classifier reliability","prompt":"I've trained a naive-Bayes classifier to tag customer feedback into quality, price, delivery, or support — can you run calibration bin analysis on these 80 labelled examples with their predicted probabilities so I can see if the model's confidence scores actually reflect its accuracy?"},{"title":"Detecting overconfidence in support ticket triage","prompt":"My support ticket classifier always gives very high probabilities but I'm not sure those scores are meaningful — can you compute confidence calibration bins from these 150 records with actual labels, predicted labels, and 4-class probability vectors to check if it's overconfident?"},{"title":"Pre-deployment model validation for feedback routing","prompt":"Before we deploy this feedback routing model, I want to validate its probability calibration — I have 200 labelled feedback samples with quality/price/delivery/support ground-truth labels and the model's predicted probabilities for each class. Can you produce the calibration bins report?"}],"resultDescription":"Returns confidence calibration bin data for the submitted labelled dataset: probability ranges are grouped into bins, and within each bin the endpoint reports the mean predicted confidence versus the observed accuracy, enabling reliability diagram construction and detection of over- or under-confidence in the classifier.","failureModes":["Fewer than the minimum required records submitted — returns error indicating insufficient data","Probability arrays not summing to 1 or containing values outside [0,1] — validation error","Mismatched enum values in actual/predicted fields — schema rejection","More than 200 records submitted — truncation or rejection depending on implementation","Empty records array — error with no bins returned"],"whenToPreferThis":"Choose this endpoint when you need to evaluate the probability calibration of a 4-class feedback theme classifier (quality, price, delivery, support) using a small local dataset of up to 200 labelled examples. It is ideal for post-hoc model evaluation without requiring a hosted model or foundation model. Prefer it over generic ML APIs when you specifically need calibration bin statistics rather than raw accuracy metrics, and when your classifier is a naive-Bayes or similar baseline model on customer feedback categories.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-19T01:29:03.782Z","isFirstParty":false,"canonicalSlug":"feedback-theme-confidence-calibration-bins-011125c3"}