{"uid":"cap_rb8LY6tylDHlRcBFfGH_C","slug":"commerce-intent-multiclass-brier-score-calculator-0c136543","name":"Commerce Intent Multiclass Brier Score Calculator","description":"Commerce intent - Multiclass Brier score: Multiclass Brier score for Commerce intent. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded multiclass brier score deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-commerce-intent-brier?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["browse","purchase","return","other"],"type":"string"},"predicted":{"enum":["browse","purchase","return","other"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"browse sample document number 0 for this supplied dataset.","actual":"browse","predicted":"browse","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"browse sample document number 1 for this supplied dataset.","actual":"browse","predicted":"browse","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"browse sample document number 2 for this supplied dataset.","actual":"browse","predicted":"browse","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"purchase sample document number 0 for this supplied dataset.","actual":"purchase","predicted":"purchase","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"purchase sample document number 1 for this supplied dataset.","actual":"purchase","predicted":"purchase","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"purchase sample document number 2 for this supplied dataset.","actual":"purchase","predicted":"purchase","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"return sample document number 0 for this supplied dataset.","actual":"return","predicted":"return","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"return sample document number 1 for this supplied dataset.","actual":"return","predicted":"return","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"return sample document number 2 for this supplied dataset.","actual":"return","predicted":"return","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"other sample document number 0 for this supplied dataset.","actual":"other","predicted":"other","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"other sample document number 1 for this supplied dataset.","actual":"other","predicted":"other","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"other sample document number 2 for this supplied dataset.","actual":"other","predicted":"other","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_jsqBRGNhgcDS6A7kBCPNY","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes the multiclass Brier score for a commerce intent classifier across up to 200 labeled text records with browse/purchase/return/other categories.","exampleAgentPrompt":"Evaluate my commerce intent classifier using a Brier score — I have 50 labeled records where each has the actual intent (browse, purchase, return, or other), the predicted intent, and a 4-element probability vector. Can you compute the multiclass Brier score across all of them?","exampleUseCases":[{"title":"Classifier calibration audit before deployment","prompt":"Before we ship our new purchase-intent model, can you compute the multiclass Brier score on these 120 labeled validation records? Each has the actual label (browse, purchase, return, or other), our model's predicted class, and the 4-class probability output so we can check how well-calibrated it is."},{"title":"A/B comparison of two intent models","prompt":"I have 80 test records with ground-truth commerce intents and probability outputs from two different classifiers. Can you calculate the Brier score for Model A's predictions — actual and predicted labels are browse/purchase/return/other with a 4-value probability array per record — so I can compare it against Model B?"},{"title":"Naive-Bayes baseline evaluation for commerce NLP","prompt":"I've built a naive-Bayes baseline for classifying user messages into browse, purchase, return, or other intents. Can you score its predictions using the multiclass Brier score on my 200 labeled records, each with the actual class, predicted class, and the 4-class probability distribution?"}],"resultDescription":"Returns the multiclass Brier score — a bounded probabilistic metric (0 to 2, lower is better) summarizing how well the predicted class probability vectors match the true one-hot labels across all submitted records. The result reflects both accuracy and calibration of the commerce intent classifier.","failureModes":["More than 200 records submitted — exceeds maximum batch size","Probability vector does not contain exactly 4 elements per record","Probability values outside [0,1] range","Invalid or unrecognized intent class label (must be browse, purchase, return, or other)","Missing required fields (id, text, actual, predicted, probabilities) on any record","Empty records array submitted"],"whenToPreferThis":"Choose this endpoint when you need a fast, low-cost ($0.01 USDC) probabilistic evaluation of a 4-class commerce intent classifier (browse/purchase/return/other) using the Brier score metric on up to 200 labeled records. Prefer it when you want to assess both accuracy and probability calibration of predicted class distributions without needing a hosted model or foundation-model retraining — especially useful for local model benchmarking or validation pipeline integration.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-20T00:58:24.463Z","isFirstParty":false,"canonicalSlug":"commerce-intent-multiclass-brier-score-calculator-0c136543"}