{"uid":"cap_qEom7n1fVq7Rz9K84tBm8","slug":"release-change-type-cross-validation-baseline-evaluator-e8702d88","name":"Release Change Type Cross-Validation Baseline Evaluator","description":"Release change - Grouped three-fold baseline evaluation: Grouped three-fold baseline evaluation for Release change. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded grouped three-fold baseline evaluation deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-release-change-cross-validation?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"actual":{"enum":["feature","fix","documentation","maintenance"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"feature sample document number 0 for this supplied dataset.","actual":"feature"},{"id":"example-0-1","text":"feature sample document number 1 for this supplied dataset.","actual":"feature"},{"id":"example-0-2","text":"feature sample document number 2 for this supplied dataset.","actual":"feature"},{"id":"example-1-0","text":"fix sample document number 0 for this supplied dataset.","actual":"fix"},{"id":"example-1-1","text":"fix sample document number 1 for this supplied dataset.","actual":"fix"},{"id":"example-1-2","text":"fix sample document number 2 for this supplied dataset.","actual":"fix"},{"id":"example-2-0","text":"documentation sample document number 0 for this supplied dataset.","actual":"documentation"},{"id":"example-2-1","text":"documentation sample document number 1 for this supplied dataset.","actual":"documentation"},{"id":"example-2-2","text":"documentation sample document number 2 for this supplied dataset.","actual":"documentation"},{"id":"example-3-0","text":"maintenance sample document number 0 for this supplied dataset.","actual":"maintenance"},{"id":"example-3-1","text":"maintenance sample document number 1 for this supplied dataset.","actual":"maintenance"},{"id":"example-3-2","text":"maintenance sample document number 2 for this supplied dataset.","actual":"maintenance"}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_P5YM-ivvKQolDeTbSyB9P","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Runs a grouped three-fold cross-validation using a naive-Bayes classifier on up to 200 labelled release change records to evaluate text classification accuracy across feature, fix, documentation, and maintenance categories.","exampleAgentPrompt":"Run a grouped three-fold baseline cross-validation on these 12 labelled release change records — each tagged as feature, fix, documentation, or maintenance — and tell me how accurately the naive-Bayes model performs across the folds.","exampleUseCases":[{"title":"Changelog classifier quality check","prompt":"I have 80 labelled release notes — each marked as either feature, fix, documentation, or maintenance — can you run a three-fold cross-validation on them and tell me the baseline accuracy I can expect from a naive-Bayes model?"},{"title":"Pre-training dataset validation","prompt":"Before I invest in training a bigger model on my release change dataset, can you do a quick grouped three-fold baseline evaluation on my 150 labelled records to see if the categories are actually learnable?"},{"title":"Team sprint retrospective on label quality","prompt":"Our team manually labelled 60 commit messages as feature, fix, documentation, or maintenance — run a baseline cross-validation to see if the labels are consistent enough that even a simple model can learn them."}],"resultDescription":"A grouped three-fold cross-validation result using a naive-Bayes baseline classifier, including per-fold and aggregate accuracy or performance metrics across the four release change categories (feature, fix, documentation, maintenance), delivered as a single bounded evaluation report.","failureModes":["Fewer than 2 records supplied causing a validation error","Records missing required fields (id, text, actual) returning a 400 error","More than 200 records supplied exceeding the maximum and being rejected","Imbalanced classes with very few samples per category leading to unreliable fold metrics","Insufficient class representation across folds preventing proper grouped splitting","Payment not fulfilled via x402 protocol returning a 402 error"],"whenToPreferThis":"Choose this endpoint when you need a fast, cheap ($0.01 USDC) sanity-check on whether a small set of labelled release change texts (up to 200 records) is classifiable using a simple naive-Bayes model with grouped three-fold cross-validation — without needing a hosted model, foundation model, or external ML infrastructure. It is ideal for label quality validation or quick baseline benchmarking before committing to more expensive model training.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-18T00:58:41.351Z","isFirstParty":false,"canonicalSlug":"release-change-type-cross-validation-baseline-evaluator-e8702d88"}