{"uid":"cap_kp8-dzBPa0-hBPjJGXi2c","slug":"training-question-label-and-prediction-audit-b6eca1e9","name":"Training Question Label and Prediction Audit","description":"Training question - Label and prediction audit: Label and prediction audit for Training question. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded label and prediction audit deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-training-question-label-audit?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["concept","procedure","example","assessment"],"type":"string"},"predicted":{"enum":["concept","procedure","example","assessment"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"concept sample document number 0 for this supplied dataset.","actual":"concept","predicted":"concept","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"concept sample document number 1 for this supplied dataset.","actual":"concept","predicted":"concept","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"concept sample document number 2 for this supplied dataset.","actual":"concept","predicted":"concept","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"procedure sample document number 0 for this supplied dataset.","actual":"procedure","predicted":"procedure","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"procedure sample document number 1 for this supplied dataset.","actual":"procedure","predicted":"procedure","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"procedure sample document number 2 for this supplied dataset.","actual":"procedure","predicted":"procedure","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"example sample document number 0 for this supplied dataset.","actual":"example","predicted":"example","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"example sample document number 1 for this supplied dataset.","actual":"example","predicted":"example","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"example sample document number 2 for this supplied dataset.","actual":"example","predicted":"example","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"assessment sample document number 0 for this supplied dataset.","actual":"assessment","predicted":"assessment","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"assessment sample document number 1 for this supplied dataset.","actual":"assessment","predicted":"assessment","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"assessment sample document number 2 for this supplied dataset.","actual":"assessment","predicted":"assessment","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_9KfKPfZs4EHK3lDeg4MNN","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Audits labels and model predictions for up to 200 text records classified into training question categories (concept, procedure, example, assessment), returning performance metrics and error analysis.","exampleAgentPrompt":"Can you audit these 50 training question records for me — each has an actual label (concept, procedure, example, or assessment), a predicted label, and probabilities — and tell me where the classifier is making mistakes and how accurate it is overall?","exampleUseCases":[{"title":"Evaluating educational content classifier","prompt":"I have 120 labelled training question records where each text is tagged as concept, procedure, example, or assessment, and my naive Bayes model made predictions with probabilities for each class — can you run a label and prediction audit so I can see per-class accuracy and which categories are getting confused?"},{"title":"Identifying mislabelled training data","prompt":"Run a prediction audit on these 80 training question records — I want to find examples where the actual label disagrees with the predicted label so I can clean up my training dataset before retraining."},{"title":"Benchmarking classifier before deployment","prompt":"Before I deploy my training question classifier, can you audit 200 of its predictions against the ground-truth labels and give me a breakdown of where it struggles — especially between procedure and example categories?"}],"resultDescription":"Returns a bounded label and prediction audit deliverable covering accuracy metrics, per-class performance breakdown, and misclassification analysis for up to 200 supplied records across the four training question categories (concept, procedure, example, assessment). Includes comparison of actual vs predicted labels and probability-based diagnostics.","failureModes":["Records array exceeds 200 items — request rejected or truncated","Missing required fields (id, text, actual, predicted, probabilities) in any record — validation error","Probabilities array does not contain exactly 4 values or values fall outside [0,1] — schema error","Invalid enum value for actual or predicted (must be concept, procedure, example, or assessment) — validation error","Empty records array — returns empty or minimal audit report","id field exceeds 80 characters — schema rejection"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, low-cost audit of classifier predictions on educational/training question text without needing a hosted model or large-scale infrastructure. Best suited for small batches (up to 200 records), naive Bayes or similar small classifiers, and when you want a quick evaluation report for concept/procedure/example/assessment classification. Use when you have pre-computed predictions and probabilities and need an independent audit rather than retraining.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-24T12:59:15.362Z","isFirstParty":false,"canonicalSlug":"training-question-label-and-prediction-audit-b6eca1e9"}