{"uid":"cap_ZgN1kOIhkmZkFAWugNhic","slug":"mekler-ai-url-inventory-extractor-42506122","name":"Mekler AI URL Inventory Extractor","description":"Extract a bounded URL inventory from static HTML anchors or same-origin XML sitemaps. Return normalized URLs, anchor text, relation flags, source and coverage bounds; deduplicate links while retaining occurrence counts. Up to 200 URLs and five uncompressed 1 MiB sitemap documents. No JavaScript rendering, linked-page crawl, reachability checks or search-index completeness.","url":"https://api.mekler.ai/v1/web/links/extract-inventory?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"url":{"type":"string","maxLength":2048},"mode":{"enum":["links","sitemap"],"type":"string","default":"links"},"max_urls":{"type":"integer","default":100,"maximum":200,"minimum":1},"request_id":{"type":"string","pattern":"^[A-Za-z0-9_-]{16,64}$"},"max_sitemaps":{"type":"integer","default":3,"maximum":5,"minimum":1}}},"responseSchema":{"type":"json","example":{"url":"https://mekler.ai/","mode":"links","links":[{"rel":["help"],"url":"https://mekler.ai/start/","anchor":"Get started","source":"https://mekler.ai/","internal":true,"occurrences":1}],"bounds":{"max_urls":100,"max_sitemaps":3},"status":"ok","skipped":[],"truncated":false,"limitations":["Static anchors or uncompressed XML sitemaps only; no JavaScript execution, linked-page crawling, reachability checks or search-index coverage.","Fragments are removed; query strings are retained. Page links are deduplicated by normalized URL with occurrence counts. Link evidence is capped at 24 KiB; truncated marks either byte or count limits.","Sitemap traversal stays on the starting origin, follows at most 5 sitemap documents of 1 MiB each, and returns at most 200 URLs. Bounds/skips describe coverage, not completeness of the site."],"observed_at":"2026-10-20T00:00:00Z","sources_visited":["https://mekler.ai/"],"pending_sitemaps":0,"canonical_candidates":["https://mekler.ai/"]}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.005","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.005/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_YHXVTsPdJFA6xjbzHWp8t","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.005","costPer":"request","priority":0,"asset":"EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Extracts a bounded, deduplicated inventory of URLs from static HTML anchor tags or same-origin XML sitemaps, returning normalized URLs with anchor text, relation flags, and occurrence counts.","exampleAgentPrompt":"Can you extract all the links from https://example.com using sitemap mode and give me up to 150 URLs, including their anchor text and whether they're internal or external?","exampleUseCases":[{"title":"Sitemap URL inventory for content audit","prompt":"Pull the full URL list from https://myblog.com/sitemap.xml using sitemap mode — I want up to 200 URLs so I can audit which pages are published and indexed."},{"title":"Internal link map for SEO analysis","prompt":"Extract all anchor links from https://acmecorp.com in links mode, up to 150 URLs, so I can see which internal pages are linked from the homepage and how many times each appears."},{"title":"Outbound link discovery for a static page","prompt":"Get me the complete link inventory from https://docs.openproject.com/overview — I need the anchor text, the relation types, and whether each link is internal or external."}],"resultDescription":"A JSON object containing a deduplicated list of up to 200 normalized URLs found on the page or in sitemaps, each with anchor text, rel attributes, internal/external flag, source URL, and occurrence count. Also includes coverage bounds, truncation flag, list of sources visited, canonical URL candidates, any skipped sitemaps, and a timestamp of when the data was observed.","failureModes":["JavaScript-rendered links not returned — only static HTML anchors are parsed","Sitemap documents over 1 MiB per file are skipped","Cross-origin sitemaps are not followed — only same-origin sitemap traversal","More than 200 URLs causes truncation with truncated=true flag","Unreachable or malformed URLs in sitemaps are skipped and reported in skipped array","Non-XML sitemaps or HTML pages with no anchors return empty links array","Private or access-restricted URLs return fetch errors"],"whenToPreferThis":"Use this endpoint when you need a fast, structured, deduplicated inventory of links or sitemap URLs from a static web page without needing JavaScript execution, full crawling, or reachability verification. Ideal for SEO audits, content mapping, or pre-crawl reconnaissance where bounded, normalized URL lists suffice. Prefer it over full crawlers when cost, speed, and simplicity matter more than completeness.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-29T13:12:45.851Z","isFirstParty":false,"canonicalSlug":"mekler-ai-url-inventory-extractor-42506122"}