{"uid":"cap_dyM3_KyJ7aI6drb1JQ9a9","slug":"knowledge-topic-multiclass-brier-score-calculator-21a32094","name":"Knowledge Topic Multiclass Brier Score Calculator","description":"Knowledge topic - Multiclass Brier score: Multiclass Brier score for Knowledge topic. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded multiclass brier score deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-knowledge-topic-brier?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["setup","usage","troubleshooting","reference"],"type":"string"},"predicted":{"enum":["setup","usage","troubleshooting","reference"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"setup sample document number 0 for this supplied dataset.","actual":"setup","predicted":"setup","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"setup sample document number 1 for this supplied dataset.","actual":"setup","predicted":"setup","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"setup sample document number 2 for this supplied dataset.","actual":"setup","predicted":"setup","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"usage sample document number 0 for this supplied dataset.","actual":"usage","predicted":"usage","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"usage sample document number 1 for this supplied dataset.","actual":"usage","predicted":"usage","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"usage sample document number 2 for this supplied dataset.","actual":"usage","predicted":"usage","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"troubleshooting sample document number 0 for this supplied dataset.","actual":"troubleshooting","predicted":"troubleshooting","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"troubleshooting sample document number 1 for this supplied dataset.","actual":"troubleshooting","predicted":"troubleshooting","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"troubleshooting sample document number 2 for this supplied dataset.","actual":"troubleshooting","predicted":"troubleshooting","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"reference sample document number 0 for this supplied dataset.","actual":"reference","predicted":"reference","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"reference sample document number 1 for this supplied dataset.","actual":"reference","predicted":"reference","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"reference sample document number 2 for this supplied dataset.","actual":"reference","predicted":"reference","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_jmcQTcAZJdeFrJy7DrjXd","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes the multiclass Brier score for a set of labeled text records classified into knowledge topic categories (setup, usage, troubleshooting, reference)","exampleAgentPrompt":"Compute the multiclass Brier score for my knowledge topic classifier — I have 50 labeled records, each with the actual category (setup, usage, troubleshooting, or reference), the predicted category, and the four-class probability vector.","exampleUseCases":[{"title":"Evaluating documentation classifier calibration","prompt":"I trained a naive Bayes classifier to tag documentation pages as setup, usage, troubleshooting, or reference. Can you compute the multiclass Brier score for these 80 labeled examples with their predicted probabilities so I know how well-calibrated it is?"},{"title":"Benchmarking topic model before deployment","prompt":"Before I ship this knowledge-base topic classifier, I want to score its probability estimates with the Brier metric. Here are 120 records with actual labels, predicted labels, and four-class softmax outputs — can you give me the multiclass Brier score?"},{"title":"Comparing two classifier versions","prompt":"I have two versions of my documentation topic classifier. Can you calculate the multiclass Brier score for version B's predictions? I'll supply 60 records with actual categories, predicted categories, and probability arrays across the four classes."}],"resultDescription":"A bounded multiclass Brier score value quantifying the mean squared difference between the predicted class probabilities and the one-hot actual labels across all supplied records and classes, along with supporting evaluation output for the knowledge topic classification task.","failureModes":["More than 200 records supplied — request will be rejected or truncated","Probability arrays do not contain exactly 4 values summing to 1 — validation error","Invalid class label values outside the enum (setup, usage, troubleshooting, reference) — schema rejection","Empty records array — no score can be computed","Record ID missing or exceeds 80 characters — schema validation failure","Probabilities contain values outside [0,1] range — validation error"],"whenToPreferThis":"Choose this endpoint when you need a quick, inexpensive ($0.01) Brier score evaluation for a knowledge topic text classifier with up to 200 records across exactly four categories (setup, usage, troubleshooting, reference). It is ideal for lightweight local evaluation without needing a hosted model or foundation-model infrastructure. Prefer this over generic ML evaluation services when your domain is specifically documentation/knowledge-base topic classification with this fixed four-class schema.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-18T00:58:34.447Z","isFirstParty":false,"canonicalSlug":"knowledge-topic-multiclass-brier-score-calculator-21a32094"}