{"uid":"cap_9Dd6S3MywfBJqKLza0lnl","slug":"machine-shop-deduplicate-documents-7a7b3eb9","name":"Machine Shop – Deduplicate Documents","description":"Turn Apify product scrape results into safe catalog updates with Catalog Update Gate. Find evidence in supplied documents, compare snapshots, extract typed JSON fields, inspect x402 quotes and assess API migrations. Preview inputs, evidence and cost for free. No live web search, scheduled monitoring or third-party purchasing.","url":"https://api.pay-forge.online/v1/deduplicate-documents?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"items":{"type":"array","items":{"type":"string"},"title":"Items","maxItems":100}}},"responseSchema":{"type":"json","example":{"unique":["Hello","World"],"duplicates":[{"index":1,"duplicate_of":0}]}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.005","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.005/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_8mXoKoZj4rYxNtqJ9iPxl","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.005","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Identifies and removes duplicate string items from a list, returning unique entries and a map of which items are duplicates of which.","exampleAgentPrompt":"I have a list of document snippets and I think there are duplicates in there — can you run them through the Machine Shop deduplication tool and tell me which ones are repeated and which are unique?","exampleUseCases":[{"title":"Cleaning duplicate customer feedback entries","prompt":"I've collected 80 customer feedback strings and I know some got submitted twice — can you deduplicate this list and show me which ones were exact repeats and which are unique?"},{"title":"Deduplicating API log entries","prompt":"Here's an array of log message strings from our API — some are duplicates from retries. Can you identify which ones are duplicates and give me just the unique set?"},{"title":"Collapsing repeated document chunks before analysis","prompt":"Before I analyze these text chunks I want to remove any duplicates. Here are 50 passages — please deduplicate them and tell me the index of any repeated ones so I know what was dropped."}],"resultDescription":"Returns a JSON object containing a 'unique' array of deduplicated string items and a 'duplicates' array listing the index of each duplicate along with the index of the original item it duplicates.","failureModes":["More than 100 items submitted — input array exceeds maxItems limit","Non-string items in the array may not be compared correctly","Empty array returns empty unique list with no duplicates","Payment not included or insufficient — returns 402 Payment Required","Malformed request body returns validation error"],"whenToPreferThis":"Use this endpoint when you need a straightforward, low-cost deduplication of a string array (up to 100 items) with an explicit index map showing which items are duplicates of which originals. Prefer it over manual logic when you need structured output identifying both the unique set and the duplicate relationships by index.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-20T12:45:49.154Z","isFirstParty":false,"canonicalSlug":"machine-shop-deduplicate-documents-7a7b3eb9"}