{"uid":"cap_2bJDDHv4VqNT9djHFukH9","slug":"remove-duplicates-filter-count-by-group-data-pipeline-3dcf1a91","name":"Remove Duplicates → Filter → Count by Group Data Pipeline","description":"Remove duplicate rows → Keep rows with a value → Count values by group: Process customer-supplied records: Remove duplicate rows → Keep rows with a value → Count values by group. Returns the processed output and row counts per step. No external data lookup. 0.01 USDC includes up to 300 flat records.","url":"https://market.datapackvibe.com/x402/assistant-cap-229469365aa2e85eabe5?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"field":{"type":"string","default":"text","pattern":"^[a-zA-Z][a-zA-Z0-9_]{0,39}$","maxLength":40},"records":{"type":"array","items":{"type":"object","maxProperties":30,"additionalProperties":{"type":["string","number","boolean","null"]}},"default":[{"text":" Useful example ","value":10},{"text":"Useful example","value":20},{"text":"Other row","value":5}],"maxItems":300,"minItems":1}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_x-7vegEND1OcRp7XuEU8Q","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Processes a flat record set through three sequential steps: deduplication, value-based row filtering, and grouped value counting — returning output and row counts per step.","exampleAgentPrompt":"I have a list of up to 300 customer records with a 'category' field — can you run them through the dedup, filter, and count-by-group pipeline so I can see how many unique entries fall into each category?","exampleUseCases":[{"title":"Survey response deduplication and tally","prompt":"I've got a batch of survey responses and the 'answer' field has duplicates and blanks — can you deduplicate them, drop rows without an answer, and then count how many responses fall into each answer group?"},{"title":"E-commerce order category counts","prompt":"Here are up to 300 order records with a 'product_type' field — run them through the dedup-filter-count pipeline so I can see how many unique orders exist per product category."},{"title":"Event log unique action frequency","prompt":"I have a log of user events with an 'action' field — please remove duplicate rows, keep only rows that have an action value, and count how many times each action appears."}],"resultDescription":"Returns the processed output at each pipeline stage (deduplicated records, filtered records, grouped counts) along with row counts per step, so the caller can audit data loss and see final aggregation.","failureModes":["records array is empty or missing — returns validation error","records exceed 300 items — rejected by maxItems constraint","field name does not match pattern (must start with a letter, alphanumeric/underscore, max 40 chars) — schema validation error","records contain objects with more than 30 properties — rejected by maxProperties constraint","all rows are duplicates and filtered out — returns empty result with zero counts"],"whenToPreferThis":"Choose this endpoint when you need a lightweight, all-in-one data cleaning and aggregation pipeline on up to 300 flat records without any external data lookup. It is ideal when you want deduplication, non-null filtering, and group counting in a single paid call rather than chaining separate tools. At $0.01 USDC per call it is cost-effective for small to medium batch jobs on customer-supplied tabular data.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-18T00:58:36.970Z","isFirstParty":false,"canonicalSlug":"remove-duplicates-filter-count-by-group-data-pipeline-3dcf1a91"}