{"uid":"cap_JOW-Oehb1kVW6ONrCWfFm","slug":"training-question-supplied-group-evaluation-16853480","name":"Training Question Supplied-Group Evaluation","description":"Training question - Supplied-group evaluation: Supplied-group evaluation for Training question. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded supplied-group evaluation deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-training-question-group-evaluation?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","group"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"group":{"type":"string","default":"","maxLength":80},"actual":{"enum":["concept","procedure","example","assessment"],"type":"string"},"predicted":{"enum":["concept","procedure","example","assessment"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"concept sample document number 0 for this supplied dataset.","group":"a","actual":"concept","predicted":"concept"},{"id":"example-0-1","text":"concept sample document number 1 for this supplied dataset.","group":"b","actual":"concept","predicted":"concept"},{"id":"example-0-2","text":"concept sample document number 2 for this supplied dataset.","group":"a","actual":"concept","predicted":"concept"},{"id":"example-1-0","text":"procedure sample document number 0 for this supplied dataset.","group":"a","actual":"procedure","predicted":"procedure"},{"id":"example-1-1","text":"procedure sample document number 1 for this supplied dataset.","group":"b","actual":"procedure","predicted":"procedure"},{"id":"example-1-2","text":"procedure sample document number 2 for this supplied dataset.","group":"a","actual":"procedure","predicted":"procedure"},{"id":"example-2-0","text":"example sample document number 0 for this supplied dataset.","group":"a","actual":"example","predicted":"example"},{"id":"example-2-1","text":"example sample document number 1 for this supplied dataset.","group":"b","actual":"example","predicted":"example"},{"id":"example-2-2","text":"example sample document number 2 for this supplied dataset.","group":"a","actual":"example","predicted":"example"},{"id":"example-3-0","text":"assessment sample document number 0 for this supplied dataset.","group":"a","actual":"assessment","predicted":"assessment"},{"id":"example-3-1","text":"assessment sample document number 1 for this supplied dataset.","group":"b","actual":"assessment","predicted":"assessment"},{"id":"example-3-2","text":"assessment sample document number 2 for this supplied dataset.","group":"a","actual":"assessment","predicted":"assessment"}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_OCCS6RQKaAdI_fncxvTjY","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Evaluates a classifier's performance on labeled training-question records segmented by group, returning per-group and overall accuracy metrics.","exampleAgentPrompt":"Evaluate my training question classifier's performance by group — here are up to 200 labeled records where each has an id, the text, a group tag, the actual label (concept, procedure, example, or assessment), and the predicted label. Give me a breakdown of accuracy and errors per group.","exampleUseCases":[{"title":"Auditing classifier bias across student cohorts","prompt":"I have 150 labeled training questions split between two student groups, A and B. Each record has an id, the question text, the actual type (concept, procedure, example, or assessment), and what my model predicted. Can you run a group evaluation so I can see if my classifier performs worse for one group than the other?"},{"title":"Benchmarking a baseline model on tagged content","prompt":"I've got a small dataset of 80 tagged instructional text records across groups 'beginner' and 'advanced' — each tagged as concept, procedure, example, or assessment with both the actual and predicted labels. Run a group evaluation and tell me where the baseline model is making the most mistakes."},{"title":"Validating labeling consistency before model training","prompt":"Before I train a full model, I want to sanity-check my labels using a naive-Bayes baseline. I have 200 records with ids, text snippets, group names, actual labels, and predicted labels. Can you do a supplied-group evaluation and show me the per-group accuracy breakdown?"}],"resultDescription":"A structured evaluation report broken down by group, including per-group accuracy, confusion between the four classes (concept, procedure, example, assessment), and overall aggregate metrics across all supplied records (up to 200).","failureModes":["More than 200 records submitted — exceeds the bounded deliverable limit","Records missing required fields (id, text, actual, predicted, group) — validation error","Labels outside the allowed enum (concept, procedure, example, assessment) — schema rejection","Empty records array — no evaluation possible","Malformed JSON body — request rejected"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, per-group breakdown of classifier performance on training question data (concept/procedure/example/assessment labels) using a supplied labeled dataset of up to 200 records, without requiring a hosted model or foundation-model infrastructure. Ideal for rapid auditing of label quality, cohort-level bias detection, or benchmarking a naive-Bayes baseline cheaply at $0.01 per call.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-24T06:50:31.305Z","isFirstParty":false,"canonicalSlug":"training-question-supplied-group-evaluation-16853480"}