{"uid":"cap_m7PLvvflPERtRh3eNZfXn","slug":"task-type-classifier-confidence-calibration-bins-4f389683","name":"Task Type Classifier — Confidence Calibration Bins","description":"Task type - Confidence calibration bins: Confidence calibration bins for Task type. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded confidence calibration bins deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-task-type-calibration?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["research","writing","analysis","implementation"],"type":"string"},"predicted":{"enum":["research","writing","analysis","implementation"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"research sample document number 0 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"research sample document number 1 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"research sample document number 2 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"writing sample document number 0 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"writing sample document number 1 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"writing sample document number 2 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"analysis sample document number 0 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"analysis sample document number 1 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"analysis sample document number 2 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"implementation sample document number 0 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"implementation sample document number 1 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"implementation sample document number 2 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_isUMxLL1CQz-8n17ZqCFV","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes confidence calibration bins for a task-type text classifier (research/writing/analysis/implementation) from up to 200 labelled records with predicted probabilities.","exampleAgentPrompt":"I have up to 200 labelled records with actual task types (research, writing, analysis, or implementation), what my classifier predicted, and the 4-class predicted probabilities for each — can you compute confidence calibration bins so I can see how well-calibrated my model's confidence scores are?","exampleUseCases":[{"title":"Diagnosing overconfident task classifier","prompt":"My task-type classifier always predicts very high probabilities but seems wrong a lot — here are 150 labelled examples with their actual labels, predicted labels, and 4-class probability outputs. Can you compute calibration bins so I can see how overconfident it really is?"},{"title":"Validating retrained model calibration","prompt":"I just retrained my research/writing/analysis/implementation classifier and want to check if the new version is better calibrated than the old one. Here are 200 labelled test records with predicted probabilities — please generate the confidence calibration bins."},{"title":"Pre-deployment calibration audit","prompt":"Before we ship this task-type classifier to production, I need a calibration report. I have 180 held-out records with actual task labels, predicted labels, and predicted probabilities for all four classes — can you run the calibration bins analysis?"}],"resultDescription":"A bounded deliverable containing confidence calibration bins for the 4-class task-type classifier — showing how predicted probability ranges align with observed accuracy across bins, enabling reliability diagram construction and detection of over/under-confidence.","failureModes":["More than 200 records submitted — input exceeds maximum batch size","Probability arrays with fewer or more than 4 elements — minItems/maxItems violation","Probabilities outside [0,1] range — schema validation failure","Invalid class label not in enum (research/writing/analysis/implementation) — rejection","Empty records array — no data to calibrate","Missing required fields (id, text, actual, predicted, probabilities) per record"],"whenToPreferThis":"Choose this endpoint when you need to evaluate the calibration quality of a 4-class task-type text classifier (research/writing/analysis/implementation) using your own labelled dataset of up to 200 records. It is particularly well-suited for lightweight, local-style evaluation without requiring a hosted model or foundation model training pipeline. Prefer it over generic calibration tools when your classes are exactly these four task types and you want a cheap ($0.01 USDC), bounded, single-deliverable calibration report.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-16T00:54:07.149Z","isFirstParty":false,"canonicalSlug":"task-type-classifier-confidence-calibration-bins-4f389683"}