{"uid":"cap_zQn_cU9maTDwd7El3W-sv","slug":"release-change-confidence-calibration-bins-09a00e48","name":"Release Change Confidence Calibration Bins","description":"Release change - Confidence calibration bins: Confidence calibration bins for Release change. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded confidence calibration bins deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-release-change-calibration?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["feature","fix","documentation","maintenance"],"type":"string"},"predicted":{"enum":["feature","fix","documentation","maintenance"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"feature sample document number 0 for this supplied dataset.","actual":"feature","predicted":"feature","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"feature sample document number 1 for this supplied dataset.","actual":"feature","predicted":"feature","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"feature sample document number 2 for this supplied dataset.","actual":"feature","predicted":"feature","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"fix sample document number 0 for this supplied dataset.","actual":"fix","predicted":"fix","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"fix sample document number 1 for this supplied dataset.","actual":"fix","predicted":"fix","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"fix sample document number 2 for this supplied dataset.","actual":"fix","predicted":"fix","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"documentation sample document number 0 for this supplied dataset.","actual":"documentation","predicted":"documentation","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"documentation sample document number 1 for this supplied dataset.","actual":"documentation","predicted":"documentation","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"documentation sample document number 2 for this supplied dataset.","actual":"documentation","predicted":"documentation","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"maintenance sample document number 0 for this supplied dataset.","actual":"maintenance","predicted":"maintenance","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"maintenance sample document number 1 for this supplied dataset.","actual":"maintenance","predicted":"maintenance","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"maintenance sample document number 2 for this supplied dataset.","actual":"maintenance","predicted":"maintenance","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_CHfpTm0YJ893zpsI4snIF","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes confidence calibration bins for a release-change classifier (feature/fix/documentation/maintenance) from up to 200 labelled text records with predicted probabilities.","exampleAgentPrompt":"I have 150 labelled release-change records — each has the actual label (feature, fix, documentation, or maintenance), the predicted label, and the 4-class probability vector from my classifier. Can you run confidence calibration bins on them so I can see how well the predicted probabilities match the true outcomes?","exampleUseCases":[{"title":"Auditing overconfident release classifier","prompt":"My release-change model keeps predicting 'feature' with 90% confidence but is wrong a lot — can you compute calibration bins for these 120 records with their actual labels, predicted labels, and probability scores so I can see where it's miscalibrated?"},{"title":"Pre-deployment model quality check","prompt":"Before shipping this release-change classifier to production, I want to verify its confidence scores are trustworthy. Here are 200 labelled examples with actual categories, predictions, and 4-class probabilities — please calculate the calibration bins for me."},{"title":"Comparing two classifier versions","prompt":"I've got two sets of release-change predictions from different model versions and I want to see which one has better-calibrated probabilities. Can you run calibration bins on this first batch of 80 records — actual labels, predicted labels, and probability arrays all included?"}],"resultDescription":"Returns a bounded confidence calibration bins deliverable: binned statistics showing how well the classifier's predicted probabilities align with actual outcomes across the feature, fix, documentation, and maintenance classes, enabling assessment of model reliability and potential miscalibration.","failureModes":["More than 200 records submitted — input truncated or rejected","Probability arrays not summing to 1 or containing values outside [0,1]","Probability arrays with fewer or more than 4 elements — schema violation","Invalid or missing class labels (must be one of: feature, fix, documentation, maintenance)","Empty records array — no calibration computable","Record IDs exceeding 80 characters or missing — validation error"],"whenToPreferThis":"Choose this endpoint when you need calibration bin statistics specifically for a 4-class release-change classifier (feature/fix/documentation/maintenance) on small datasets up to 200 records, without needing a hosted model or foundation-model training. It is ideal for lightweight local evaluation workflows and post-hoc probability calibration audits on existing classifier outputs.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-11T18:52:01.210Z","isFirstParty":false,"canonicalSlug":"release-change-confidence-calibration-bins-09a00e48"}