{"uid":"cap_SjDF4_9Lr4RCaui4UrVj-","slug":"release-change-label-and-prediction-audit-cc4a7bc2","name":"Release Change Label and Prediction Audit","description":"Release change - Label and prediction audit: Label and prediction audit for Release change. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded label and prediction audit deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-release-change-label-audit?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","probabilities"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["feature","fix","documentation","maintenance"],"type":"string"},"predicted":{"enum":["feature","fix","documentation","maintenance"],"type":"string"},"probabilities":{"type":"array","items":{"type":"number","default":0,"maximum":1,"minimum":0},"default":[],"maxItems":4,"minItems":4}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"feature sample document number 0 for this supplied dataset.","actual":"feature","predicted":"feature","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-1","text":"feature sample document number 1 for this supplied dataset.","actual":"feature","predicted":"feature","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-0-2","text":"feature sample document number 2 for this supplied dataset.","actual":"feature","predicted":"feature","probabilities":[0.8,0.06666666666666667,0.06666666666666667,0.06666666666666667]},{"id":"example-1-0","text":"fix sample document number 0 for this supplied dataset.","actual":"fix","predicted":"fix","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-1","text":"fix sample document number 1 for this supplied dataset.","actual":"fix","predicted":"fix","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-1-2","text":"fix sample document number 2 for this supplied dataset.","actual":"fix","predicted":"fix","probabilities":[0.06666666666666667,0.8,0.06666666666666667,0.06666666666666667]},{"id":"example-2-0","text":"documentation sample document number 0 for this supplied dataset.","actual":"documentation","predicted":"documentation","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-1","text":"documentation sample document number 1 for this supplied dataset.","actual":"documentation","predicted":"documentation","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-2-2","text":"documentation sample document number 2 for this supplied dataset.","actual":"documentation","predicted":"documentation","probabilities":[0.06666666666666667,0.06666666666666667,0.8,0.06666666666666667]},{"id":"example-3-0","text":"maintenance sample document number 0 for this supplied dataset.","actual":"maintenance","predicted":"maintenance","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-1","text":"maintenance sample document number 1 for this supplied dataset.","actual":"maintenance","predicted":"maintenance","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]},{"id":"example-3-2","text":"maintenance sample document number 2 for this supplied dataset.","actual":"maintenance","predicted":"maintenance","probabilities":[0.06666666666666667,0.06666666666666667,0.06666666666666667,0.8]}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_lVZADflu1URQD9RtPrzDU","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Audits classifier labels and predictions for software release change type classification (feature, fix, documentation, maintenance) across up to 200 text records.","exampleAgentPrompt":"Can you run a label and prediction audit on these 50 release note records I've classified as feature, fix, documentation, or maintenance — I'll supply the actual labels, predicted labels, and the 4-class probability scores for each one, and I want to see how accurate the predictions are?","exampleUseCases":[{"title":"CI pipeline classifier quality gate","prompt":"I've got 120 commit messages that my naive-Bayes model classified as feature, fix, documentation, or maintenance — can you audit the predictions against the actual labels and tell me where it's going wrong, including the probability scores per record?"},{"title":"Release note tagger accuracy review","prompt":"We're evaluating our release note tagger before shipping it to production. Can you run a prediction audit on these 80 labelled examples — actual and predicted classes are feature, fix, documentation, or maintenance — and give me a breakdown of where the model is miscategorizing?"},{"title":"Model calibration check for changelog classifier","prompt":"I need to check if my changelog classifier's probability scores are well-calibrated across the four categories: feature, fix, documentation, and maintenance. Here are 200 records with their actual labels, predicted labels, and 4-element probability arrays — can you audit them?"}],"resultDescription":"A bounded audit deliverable covering classification accuracy metrics, per-class performance breakdown, prediction vs actual label comparison, and probability-based analysis for up to 200 release change text records classified across four categories: feature, fix, documentation, and maintenance.","failureModes":["More than 200 records supplied — request will be rejected or truncated","Probability arrays not summing to 1 or containing values outside [0,1]","Invalid enum values for actual or predicted labels (must be feature, fix, documentation, or maintenance)","Probability arrays with fewer or more than 4 elements","Missing required fields (id, text, actual, predicted, probabilities) on any record","Empty records array returns trivial or empty audit output"],"whenToPreferThis":"Choose this endpoint when you need a fast, low-cost ($0.01) audit of classifier predictions for software release change type classification across the four canonical categories (feature, fix, documentation, maintenance), especially when you already have labelled records with probability scores and want per-record and aggregate evaluation without training or hosting a model.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-15T12:39:30.408Z","isFirstParty":false,"canonicalSlug":"release-change-label-and-prediction-audit-cc4a7bc2"}