{"uid":"cap_fZZ3zwhKxfJGjjg4knuuC","slug":"task-type-multiclass-brier-score-fb486fd2","name":"Task Type Multiclass Brier Score","description":"Task type - Multiclass Brier score: Multiclass Brier score for Task type. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded multiclass brier score deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-task-type-brier?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["research","writing","analysis","implementation"],"type":"string"},"predicted":{"enum":["research","writing","analysis","implementation"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"research sample document number 0 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"research sample document number 1 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"research sample document number 2 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"writing sample document number 0 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"writing sample document number 1 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"writing sample document number 2 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"analysis sample document number 0 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"analysis sample document number 1 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"analysis sample document number 2 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"implementation sample document number 0 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"implementation sample document number 1 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"implementation sample document number 2 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_2i-MgSZoJa6rI_QFw6jmH","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes the multiclass Brier score for a text classifier predicting task types (research, writing, analysis, implementation) from up to 200 labelled records.","exampleAgentPrompt":"Can you compute the multiclass Brier score for my task-type classifier? I have 12 labelled records where each one has the actual label (research, writing, analysis, or implementation), the predicted label, and the four class probabilities — I want to know how well-calibrated my model's probability estimates are.","exampleUseCases":[{"title":"Calibration check for NLP pipeline","prompt":"I've trained a naive-Bayes classifier that assigns documents to research, writing, analysis, or implementation. Can you calculate the multiclass Brier score on these 50 labelled examples, including the predicted probabilities for each class, so I can see how well-calibrated it is?"},{"title":"Comparing two task classifiers","prompt":"I have outputs from two different task-type models — both predict research, writing, analysis, or implementation — each with 80 labelled records and probability vectors. Can you give me the Brier score for the first batch so I can compare it against the second?"},{"title":"Pre-deployment classifier quality gate","prompt":"Before I ship my document routing model, can you evaluate its multiclass Brier score on 120 held-out records? Each record has the actual task type (research, writing, analysis, or implementation), the model's predicted label, and the four predicted probabilities summing to 1."}],"resultDescription":"Returns a bounded multiclass Brier score value for the submitted labelled records, quantifying the mean squared error between the predicted probability vectors and the one-hot actual class vectors across the four task-type categories (research, writing, analysis, implementation). Lower scores indicate better-calibrated probabilistic predictions.","failureModes":["Fewer than 1 or more than 200 records submitted — request rejected","Probability vector does not have exactly 4 elements or values outside [0,1] — validation error","Missing required fields (id, text, actual, predicted, probabilities) on any record — schema error","actual or predicted label not in enum (research, writing, analysis, implementation) — enum validation failure","Payment of 0.01 USDC not included or x402 protocol error — payment failure"],"whenToPreferThis":"Choose this endpoint when you need a proper scoring rule evaluation (Brier score) specifically for a 4-class task-type text classifier (research/writing/analysis/implementation) on small to medium labelled datasets (up to 200 records) and want a cheap, fast, bounded metric without setting up your own evaluation infrastructure.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-16T00:54:03.418Z","isFirstParty":false,"canonicalSlug":"task-type-multiclass-brier-score-fb486fd2"}