{"uid":"cap_lqy2IuzyLgygtrvvGlrNz","slug":"multiclass-brier-score-calculator-for-training-questions-28026007","name":"Multiclass Brier Score Calculator for Training Questions","description":"Training question - Multiclass Brier score: Multiclass Brier score for Training question. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded multiclass brier score deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-training-question-brier?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["concept","procedure","example","assessment"],"type":"string"},"predicted":{"enum":["concept","procedure","example","assessment"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"concept sample document number 0 for this supplied dataset.","actual":"concept","predicted":"concept","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"concept sample document number 1 for this supplied dataset.","actual":"concept","predicted":"concept","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"concept sample document number 2 for this supplied dataset.","actual":"concept","predicted":"concept","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"procedure sample document number 0 for this supplied dataset.","actual":"procedure","predicted":"procedure","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"procedure sample document number 1 for this supplied dataset.","actual":"procedure","predicted":"procedure","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"procedure sample document number 2 for this supplied dataset.","actual":"procedure","predicted":"procedure","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"example sample document number 0 for this supplied dataset.","actual":"example","predicted":"example","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"example sample document number 1 for this supplied dataset.","actual":"example","predicted":"example","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"example sample document number 2 for this supplied dataset.","actual":"example","predicted":"example","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"assessment sample document number 0 for this supplied dataset.","actual":"assessment","predicted":"assessment","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"assessment sample document number 1 for this supplied dataset.","actual":"assessment","predicted":"assessment","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"assessment sample document number 2 for this supplied dataset.","actual":"assessment","predicted":"assessment","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_VOHmcC315cyvteM0gmGey","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes the multiclass Brier score for up to 200 labelled text records classified into concept, procedure, example, or assessment categories","exampleAgentPrompt":"Can you compute the multiclass Brier score for my training question classifier? I have 50 labelled records, each with actual and predicted labels from concept, procedure, example, or assessment, plus four predicted probabilities that sum to 1.","exampleUseCases":[{"title":"Evaluating educational content classifier calibration","prompt":"I've built a naive Bayes classifier that sorts training materials into concept, procedure, example, or assessment. Can you calculate the multiclass Brier score for these 80 labelled records I have — each one has the actual label, predicted label, and four predicted probabilities?"},{"title":"Comparing model iterations on held-out data","prompt":"I want to see if my updated text classifier is better calibrated than before. Can you compute the Brier score across these 120 records with their actual categories, predicted categories, and probability vectors so I can compare it to my previous run?"},{"title":"Quality check before deploying a question tagger","prompt":"Before I go live with my question-tagging model, can you run a Brier score evaluation on these 200 sample records — each has the true label (concept, procedure, example, or assessment), what the model predicted, and the four class probabilities?"}],"resultDescription":"Returns a single bounded multiclass Brier score deliverable — a numerical score (lower is better, 0 = perfect) representing the mean squared error between predicted class probability vectors and one-hot encoded actual labels across all submitted records.","failureModes":["Probabilities array does not contain exactly 4 elements per record","Probabilities do not sum to approximately 1.0","More than 200 records submitted in one call","Invalid or missing actual/predicted class labels outside allowed enum values","Empty records array provided","Record ID exceeds 80 character limit"],"whenToPreferThis":"Choose this endpoint when you need a probabilistic calibration metric (Brier score) for a four-class text classification problem with labels concept, procedure, example, and assessment — particularly for training question datasets. It is purpose-built for this exact label schema and handles up to 200 records per call at minimal cost, making it ideal for iterative model evaluation without needing hosted model infrastructure.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-24T06:51:10.466Z","isFirstParty":false,"canonicalSlug":"multiclass-brier-score-calculator-for-training-questions-28026007"}