{"uid":"cap_M8Rh9fcDZXNQ7G8x8-lux","slug":"task-type-supplied-group-evaluation-462894d2","name":"Task Type Supplied-Group Evaluation","description":"Task type - Supplied-group evaluation: Supplied-group evaluation for Task type. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded supplied-group evaluation deliverable.","url":"https://market.datapackvibe.com/x402/assistant-sector-ml-task-type-group-evaluation?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"records":{"type":"array","items":{"type":"object","required":["id","text","actual","predicted","group"],"properties":{"id":{"type":"string","default":"","maxLength":80,"minLength":1},"text":{"type":"string","default":"","maxLength":1000},"group":{"type":"string","default":"","maxLength":80},"actual":{"enum":["research","writing","analysis","implementation"],"type":"string"},"predicted":{"enum":["research","writing","analysis","implementation"],"type":"string"}},"additionalProperties":false},"default":[{"id":"example-0-0","text":"research sample document number 0 for this supplied dataset.","group":"a","actual":"research","predicted":"research"},{"id":"example-0-1","text":"research sample document number 1 for this supplied dataset.","group":"b","actual":"research","predicted":"research"},{"id":"example-0-2","text":"research sample document number 2 for this supplied dataset.","group":"a","actual":"research","predicted":"research"},{"id":"example-1-0","text":"writing sample document number 0 for this supplied dataset.","group":"a","actual":"writing","predicted":"writing"},{"id":"example-1-1","text":"writing sample document number 1 for this supplied dataset.","group":"b","actual":"writing","predicted":"writing"},{"id":"example-1-2","text":"writing sample document number 2 for this supplied dataset.","group":"a","actual":"writing","predicted":"writing"},{"id":"example-2-0","text":"analysis sample document number 0 for this supplied dataset.","group":"a","actual":"analysis","predicted":"analysis"},{"id":"example-2-1","text":"analysis sample document number 1 for this supplied dataset.","group":"b","actual":"analysis","predicted":"analysis"},{"id":"example-2-2","text":"analysis sample document number 2 for this supplied dataset.","group":"a","actual":"analysis","predicted":"analysis"},{"id":"example-3-0","text":"implementation sample document number 0 for this supplied dataset.","group":"a","actual":"implementation","predicted":"implementation"},{"id":"example-3-1","text":"implementation sample document number 1 for this supplied dataset.","group":"b","actual":"implementation","predicted":"implementation"},{"id":"example-3-2","text":"implementation sample document number 2 for this supplied dataset.","group":"a","actual":"implementation","predicted":"implementation"}],"maxItems":200,"minItems":2}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_Sk_VWZqguZjMIUgVA3gTd","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Evaluates a supplied set of labelled text records for task-type classification (research/writing/analysis/implementation) broken down by group, with per-group metrics and naive-Bayes baselines.","exampleAgentPrompt":"I have up to 200 labelled text records where each record has an actual and predicted task type (research, writing, analysis, or implementation) plus a group label — can you run a supplied-group evaluation to get per-group classification metrics and a naive-Bayes baseline comparison?","exampleUseCases":[{"title":"QA team model performance review","prompt":"We have 150 labelled documents from two teams — team A and team B — each tagged with an actual task type and what our classifier predicted (research, writing, analysis, or implementation). Can you evaluate our classifier's performance broken down by team group and include a naive-Bayes baseline?"},{"title":"Cross-source label consistency check","prompt":"I have records from three data sources (groups 'source-1', 'source-2', 'source-3') with actual and predicted task-type labels. Please run a group-level evaluation on these 180 records so I can see where each source's predictions diverge most from the actual labels."},{"title":"Classifier iteration benchmarking","prompt":"After retraining our task classifier, I want to compare how well it labels documents as research, writing, analysis, or implementation — split by project group. Here are 120 records with actual and predicted labels; please give me per-group accuracy metrics and a naive-Bayes baseline to compare against."}],"resultDescription":"A bounded evaluation deliverable containing per-group classification metrics (accuracy, precision, recall, F1) for task-type labels (research, writing, analysis, implementation), a naive-Bayes baseline comparison, and local dataset summary statistics — all derived from the supplied labelled text records.","failureModes":["More than 200 records supplied — exceeds the bounded limit and may be rejected","Missing required fields (id, text, actual, predicted, group) on any record causes validation error","Invalid enum values for actual or predicted labels outside the four permitted classes","Empty records array returns no evaluation output","Text exceeding 1000 characters per record may be truncated or rejected","Payment failure via x402 protocol prevents response delivery"],"whenToPreferThis":"Choose this endpoint when you have your own labelled dataset of up to 200 text records with actual and predicted task-type labels and need group-stratified evaluation metrics plus a naive-Bayes baseline — without needing a hosted model or foundation-model training. It is ideal for lightweight offline-style benchmarking where you supply all the data and just need structured performance analysis broken down by a categorical group variable.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-15T18:48:55.625Z","isFirstParty":false,"canonicalSlug":"task-type-supplied-group-evaluation-462894d2"}