{"uid":"cap_SrDTm7zk3QRswF09Hz65I","slug":"data-pipeline-runs-exact-row-deduplication-c4a6ca1d","name":"Data Pipeline Runs – Exact Row Deduplication","description":"Data pipeline runs - Exact row deduplication: Exact row deduplication for Data pipeline runs. Up to 200 supplied typed records. Local descriptive analytics; no enrichment or forecast. One of 25 new profiles across 20 shared operations in this industry. 0.01 USDC includes one bounded exact row deduplication report.","url":"https://market.datapackvibe.com/x402/assistant-ar-analytics-pipeline-runs-deduplicate?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"rows":{"type":"array","items":{"type":"object","required":["row_id","pipeline","date","processed_rows","rejected_rows"],"properties":{"date":{"type":"string","default":"","pattern":"^\\d{4}-\\d{2}-\\d{2}$","maxLength":10},"row_id":{"type":"string","default":"","maxLength":80,"minLength":1},"pipeline":{"type":"string","default":"","maxLength":80},"rejected_rows":{"type":["number","null"],"maximum":1000000000000,"minimum":-1000000000000},"processed_rows":{"type":["number","null"],"maximum":1000000000000,"minimum":-1000000000000}},"additionalProperties":false},"default":[{"date":"2026-10-01","row_id":"row-1","pipeline":"group-a","rejected_rows":1,"processed_rows":10},{"date":"2026-10-02","row_id":"row-2","pipeline":"group-b","rejected_rows":2,"processed_rows":20},{"date":"2026-10-03","row_id":"row-3","pipeline":"group-a","rejected_rows":3,"processed_rows":15},{"date":"2026-10-04","row_id":"row-4","pipeline":"group-b","rejected_rows":4,"processed_rows":30}],"maxItems":200,"minItems":1}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.01","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.01/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.01","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_pyfQDns-w_gMqxbEZ2j63","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.01","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Removes exact duplicate rows from up to 200 data pipeline run records (by pipeline, date, processed_rows, rejected_rows) and returns a deduplication report.","exampleAgentPrompt":"Deduplicate these pipeline run records for me — I have up to 50 rows each with a row_id, pipeline name, date, processed_rows, and rejected_rows, and I want a clean report showing which exact duplicates were removed.","exampleUseCases":[{"title":"Clean ETL pipeline run logs","prompt":"I have a batch of 80 pipeline run records from last month — some rows got duplicated during ingestion. Can you run exact deduplication on them so I only keep unique entries by pipeline, date, and row counts?"},{"title":"Pre-analysis data quality check","prompt":"Before I run analytics on my pipeline metrics, can you deduplicate these 120 records? Each has a row_id, pipeline name, date, processed_rows, and rejected_rows — I want duplicates stripped out first."},{"title":"Validate pipeline monitoring data","prompt":"Our monitoring system logged the same pipeline runs multiple times today. I've got 45 rows with fields like row_id, pipeline, date, processed_rows, and rejected_rows — can you remove all exact duplicates and tell me how many were found?"}],"resultDescription":"A bounded exact row deduplication report listing which of the supplied pipeline run records were duplicates, the deduplicated (unique) set of rows, and summary statistics — all computed locally without external enrichment or forecasting.","failureModes":["Fewer than 1 row supplied returns a validation error","More than 200 rows supplied exceeds the maxItems limit","Invalid date format (not YYYY-MM-DD) causes schema rejection","Missing required fields (row_id, pipeline, date, processed_rows, rejected_rows) causes rejection","Numeric values outside ±1,000,000,000,000 range fail validation","Payment not included or insufficient USDC triggers x402 payment required response"],"whenToPreferThis":"Choose this endpoint when you have up to 200 typed pipeline run records and need a fast, cheap ($0.01 USDC) exact-match deduplication report with no external API calls or enrichment — ideal for pre-analysis data cleaning of ETL or pipeline monitoring datasets where records share the same pipeline, date, processed_rows, and rejected_rows values.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-17T00:47:27.351Z","isFirstParty":false,"canonicalSlug":"data-pipeline-runs-exact-row-deduplication-c4a6ca1d"}