{"uid":"cap_N3ZoHfMh2kWcFQlSAJD4M","slug":"language-routing-supplied-group-evaluation-da0a20f5","name":"Language Routing Supplied-Group Evaluation","description":"Language routing - Supplied-group evaluation: Supplied-group evaluation for Language routing. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded supplied-group evaluation deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-language-routing-group-evaluation?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","group"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"group":{"type":"string","default":"","maxLength":80},"actual":{"enum":["english","french","spanish","other"],"type":"string"},"predicted":{"enum":["english","french","spanish","other"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"english sample document number 0 for this supplied dataset.","group":"a","actual":"english","predicted":"english"},{"id":"example-0-1","text":"english sample document number 1 for this supplied dataset.","group":"b","actual":"english","predicted":"english"},{"id":"example-0-2","text":"english sample document number 2 for this supplied dataset.","group":"a","actual":"english","predicted":"english"},{"id":"example-1-0","text":"french sample document number 0 for this supplied dataset.","group":"a","actual":"french","predicted":"french"},{"id":"example-1-1","text":"french sample document number 1 for this supplied dataset.","group":"b","actual":"french","predicted":"french"},{"id":"example-1-2","text":"french sample document number 2 for this supplied dataset.","group":"a","actual":"french","predicted":"french"},{"id":"example-2-0","text":"spanish sample document number 0 for this supplied dataset.","group":"a","actual":"spanish","predicted":"spanish"},{"id":"example-2-1","text":"spanish sample document number 1 for this supplied dataset.","group":"b","actual":"spanish","predicted":"spanish"},{"id":"example-2-2","text":"spanish sample document number 2 for this supplied dataset.","group":"a","actual":"spanish","predicted":"spanish"},{"id":"example-3-0","text":"other sample document number 0 for this supplied dataset.","group":"a","actual":"other","predicted":"other"},{"id":"example-3-1","text":"other sample document number 1 for this supplied dataset.","group":"b","actual":"other","predicted":"other"},{"id":"example-3-2","text":"other sample document number 2 for this supplied dataset.","group":"a","actual":"other","predicted":"other"}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_qee7K3VaWRQI0HaWG5pDE","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Evaluates the accuracy of a language routing classifier across supplied labelled text records, broken down by group membership.","exampleAgentPrompt":"Evaluate my language routing predictions — I have 50 labelled records, each with an actual language (english, french, spanish, or other) and a predicted language, split into groups A and B. Can you run a supplied-group evaluation and tell me how accurate the classifier is per group?","exampleUseCases":[{"title":"Multilingual support bot audit by region","prompt":"I have 120 labelled chat messages from our support bot, each tagged with the actual language and what our language router predicted, split into groups by region — can you evaluate how accurate the predictions are per region group?"},{"title":"A/B test of two language detection models","prompt":"We ran two versions of our language detector and labelled the results — group A is model version 1 and group B is model version 2, each with actual and predicted language labels. Can you evaluate both groups and tell me which model performed better?"},{"title":"Language classifier QA before production rollout","prompt":"Before we deploy our new language routing system, I want to check its accuracy on 80 labelled test records split into english, french, spanish, and other categories across two customer segments — can you run a group evaluation and show me where it's making mistakes?"}],"resultDescription":"Returns evaluation metrics for the language routing classifier broken down by supplied group labels, including accuracy, per-class performance, and summary statistics across up to 200 labelled text records with actual and predicted language labels (english, french, spanish, other).","failureModes":["More than 200 records submitted — request exceeds the bounded deliverable limit","Missing required fields (id, text, actual, predicted, group) on any record","Invalid enum values for actual or predicted fields outside allowed language set","Empty records array submitted","Payment not completed or insufficient USDC balance"],"whenToPreferThis":"Choose this endpoint when you have your own labelled dataset with both actual and predicted language labels and want to evaluate classifier performance segmented by group — ideal for A/B comparisons, regional cohort analysis, or QA audits of language routing systems without needing a hosted model or foundation-model training.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-15T18:47:57.244Z","isFirstParty":false,"canonicalSlug":"language-routing-supplied-group-evaluation-da0a20f5"}