{"uid":"cap_KP_PQorixRXfaYMOM2Nx5","slug":"language-routing-multiclass-brier-score-evaluator-efb60264","name":"Language Routing Multiclass Brier Score Evaluator","description":"Language routing - Multiclass Brier score: Multiclass Brier score for Language routing. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded multiclass brier score deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-language-routing-brier?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["english","french","spanish","other"],"type":"string"},"predicted":{"enum":["english","french","spanish","other"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"english sample document number 0 for this supplied dataset.","actual":"english","predicted":"english","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"english sample document number 1 for this supplied dataset.","actual":"english","predicted":"english","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"english sample document number 2 for this supplied dataset.","actual":"english","predicted":"english","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"french sample document number 0 for this supplied dataset.","actual":"french","predicted":"french","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"french sample document number 1 for this supplied dataset.","actual":"french","predicted":"french","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"french sample document number 2 for this supplied dataset.","actual":"french","predicted":"french","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"spanish sample document number 0 for this supplied dataset.","actual":"spanish","predicted":"spanish","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"spanish sample document number 1 for this supplied dataset.","actual":"spanish","predicted":"spanish","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"spanish sample document number 2 for this supplied dataset.","actual":"spanish","predicted":"spanish","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"other sample document number 0 for this supplied dataset.","actual":"other","predicted":"other","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"other sample document number 1 for this supplied dataset.","actual":"other","predicted":"other","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"other sample document number 2 for this supplied dataset.","actual":"other","predicted":"other","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_jwQNfKSeISQK1g0W8h9cb","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes the multiclass Brier score for a language routing classifier given up to 200 labelled text records with predicted probability distributions.","exampleAgentPrompt":"Compute the multiclass Brier score for my language routing classifier — I have 50 labelled records where each has the actual language (english, french, spanish, or other), the predicted label, and a 4-element probability vector for each class.","exampleUseCases":[{"title":"Calibration check for language router","prompt":"I just trained a language routing model that classifies text into english, french, spanish, or other. Can you calculate the multiclass Brier score on these 80 labelled test records — each has the actual language, predicted label, and a probability vector — so I can see how well-calibrated the predictions are?"},{"title":"Comparing two language classifier versions","prompt":"I want to compare two versions of my language detector. Can you compute the Brier score for version A's predictions? I have 120 labelled records with actual labels, predicted labels, and the 4-class probability distributions for english, french, spanish, and other."},{"title":"QA audit of production language routing","prompt":"Before we push our language routing model to production, can you run a Brier score evaluation on a held-out set of 200 records? Each record has the document text, the true language label, the model's predicted label, and the four class probabilities for english, french, spanish, and other."}],"resultDescription":"Returns a bounded multiclass Brier score scalar derived from the supplied labelled records and their predicted probability vectors, quantifying the mean squared error between the predicted probability distributions and the one-hot actual labels across english, french, spanish, and other classes.","failureModes":["More than 200 records supplied — request exceeds batch limit","Probability vectors with fewer or more than 4 elements — schema validation failure","Probabilities outside [0,1] range — validation error","Invalid or unrecognised class label in actual or predicted fields — enum validation failure","Empty records array — no data to evaluate","Malformed JSON body — request rejected"],"whenToPreferThis":"Choose this endpoint when you need a calibration-sensitive multiclass metric (Brier score) specifically for a language routing classifier over english, french, spanish, and other classes, with up to 200 labelled records per call. Prefer it over log-loss endpoints when you want a bounded, squared-error measure of probabilistic calibration rather than a logarithmic penalty. Use it for quick offline evaluation of small held-out sets without requiring a hosted model.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-16T00:53:01.195Z","isFirstParty":false,"canonicalSlug":"language-routing-multiclass-brier-score-evaluator-efb60264"}