{"uid":"cap_yFaGOwHEk-781F9bWtgUm","slug":"simhash-near-duplicate-detection-8e7d3026","name":"SimHash Near-Duplicate Detection","description":"Compute a 64-bit SimHash fingerprint for content, or compare two texts and return the Hamming distance and a 0-1 similarity score for near-duplicate detection.","url":"https://api.24klabs.ai/api/v1/simhash-dedup","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"a":{"type":"string"},"b":{"type":"string"}}},"responseSchema":{"type":"json","example":{"distance":3,"similarity":0.95}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.002","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.002/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.002","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_ZmUDoxLEyxJEB4TVDzJdy","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.002","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Computes a 64-bit SimHash fingerprint for text content, or compares two texts returning Hamming distance and a 0–1 similarity score for near-duplicate detection.","exampleAgentPrompt":"Compare these two product descriptions and tell me their SimHash similarity score and Hamming distance so I can decide if they're near-duplicates: 'Fast wireless charger for iPhone 15, 20W' and 'iPhone 15 wireless charger, 20W fast charging'.","exampleUseCases":[{"title":"Deduplicating scraped news articles","prompt":"I've scraped two news articles and want to know if they're near-duplicates — compute the SimHash similarity between 'Scientists discover new exoplanet in habitable zone' and 'Researchers find new planet in star's habitable zone' and give me the Hamming distance and similarity score."},{"title":"Fingerprinting documents for dedup pipeline","prompt":"Generate a 64-bit SimHash fingerprint for this paragraph so I can store it and check future documents against it: 'Our return policy allows refunds within 30 days of purchase with original receipt.'"},{"title":"Plagiarism check on user submissions","prompt":"Check whether these two student essay intros are near-duplicates by comparing their SimHash — 'The industrial revolution transformed society through mechanization' versus 'Mechanization during the industrial revolution fundamentally changed society' — and give me the similarity score."}],"resultDescription":"Returns a 64-bit SimHash fingerprint for a single input, or when comparing two texts returns the Hamming distance (integer, lower = more similar) and a 0–1 similarity score (higher = more similar), enabling threshold-based near-duplicate detection.","failureModes":["Empty or missing text input returns a validation error","Extremely long texts may be truncated or cause timeout","Non-text binary content is not supported","Similarity score of exactly 0 or 1 may be returned for trivially identical or completely unrelated texts","Payment failure via x402 results in 402 response"],"whenToPreferThis":"Use this endpoint when you need fast, scalable near-duplicate detection for text without requiring a full semantic embedding model — ideal for deduplication pipelines, plagiarism checks, or content fingerprinting where fuzzy matching is needed. Prefer this over exact-hash approaches (MD5/SHA) when you need to detect near-duplicates with minor edits, and prefer it over expensive embedding-based similarity when exact semantic understanding is not required.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-09-13T13:01:17.038Z","isFirstParty":false}