{"uid":"cap_AIbW8ItlOOT9HPcAvJJsR","slug":"task-type-label-and-prediction-audit-77c564e0","name":"Task Type Label and Prediction Audit","description":"Task type - Label and prediction audit: Label and prediction audit for Task type. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded label and prediction audit deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-task-type-label-audit?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["research","writing","analysis","implementation"],"type":"string"},"predicted":{"enum":["research","writing","analysis","implementation"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"research sample document number 0 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"research sample document number 1 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"research sample document number 2 for this supplied dataset.","actual":"research","predicted":"research","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"writing sample document number 0 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"writing sample document number 1 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"writing sample document number 2 for this supplied dataset.","actual":"writing","predicted":"writing","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"analysis sample document number 0 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"analysis sample document number 1 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"analysis sample document number 2 for this supplied dataset.","actual":"analysis","predicted":"analysis","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"implementation sample document number 0 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"implementation sample document number 1 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"implementation sample document number 2 for this supplied dataset.","actual":"implementation","predicted":"implementation","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_LN4ba-hZR54GVmE_kWsxG","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Audits labels and predictions for a task-type classifier (research/writing/analysis/implementation) over up to 200 text records, returning evaluation metrics and naive-Bayes baselines.","exampleAgentPrompt":"Can you audit my task-type classifier results? I have 50 labelled records where each has the actual label (research, writing, analysis, or implementation), the predicted label, and the 4-class probability scores — run a label and prediction audit and tell me where the model is going wrong.","exampleUseCases":[{"title":"Classifier accuracy check before deployment","prompt":"Before I ship my task-type model, can you audit these 120 labelled records — each has the actual task type (research, writing, analysis, or implementation), what the model predicted, and the probability scores — and tell me the overall accuracy and where it's making the most mistakes?"},{"title":"Label quality review for training data","prompt":"I think some of my training data labels might be wrong — can you run a prediction audit on these 80 records with their actual and predicted task-type labels plus probabilities, and flag the ones where the model's confidence disagrees strongly with the supplied label?"},{"title":"Baseline comparison for new task classifier","prompt":"I just built a task-type classifier and want to see how it compares to a naive-Bayes baseline. Can you run a label and prediction audit on my 200 records covering research, writing, analysis, and implementation tasks, with the actual labels, predictions, and probability arrays?"}],"resultDescription":"Returns a bounded audit deliverable including per-class and overall accuracy metrics, a confusion matrix across the four task types (research, writing, analysis, implementation), calibration analysis based on supplied probabilities, identification of misclassified records, and a naive-Bayes baseline comparison for the supplied dataset.","failureModes":["Records array exceeds 200 items — request rejected or truncated","Probabilities array does not contain exactly 4 values summing to approximately 1.0 — validation error","Invalid enum value for actual or predicted fields (must be research, writing, analysis, or implementation) — schema rejection","Empty records array returns no meaningful audit output","Record text exceeds 1000 character limit — truncation or rejection"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, low-cost audit of a 4-class task-type text classifier with local evaluation metrics and a naive-Bayes baseline, without requiring a hosted model or foundation-model infrastructure. Ideal for rapid sanity-checks on small-to-medium labelled datasets (up to 200 records) during development or QA pipelines.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-15T04:10:41.902Z","isFirstParty":false,"canonicalSlug":"task-type-label-and-prediction-audit-77c564e0"}