{"uid":"cap_W-jbFyIBC5u5HUwz7xB3T","slug":"verdict-pointer-visual-ui-element-locator-a5c08729","name":"Verdict Pointer – Visual UI Element Locator","description":"Computer-use agent helper. Send a screenshot (PNG/JPEG) and 1 to 8 element descriptions, get click coordinates (fractions and pixels) and the probability each UI element is really visible. Visual grounding for GUI automation and browser agents.","url":"https://verdict.kechlab.com/v1/pointer?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"image":{"type":"string","description":"PNG or JPEG screenshot as a base64 data URL (2 MB max)"},"width":{"type":"number","description":"(optional) screenshot width in pixels"},"height":{"type":"number","description":"(optional) height in pixels"},"targets":{"type":"array","items":{"type":"string"},"description":"list of 1 to 8 descriptions of elements to locate"}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.0256","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.0256/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.0256","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.0256","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_HWDKQ50yjsvsLoTx1zQD3","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.0256","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Given a screenshot and up to 8 UI element descriptions, returns click coordinates (fractional and pixel) plus visibility probability for each target element.","exampleAgentPrompt":"I need to click the 'Submit Order' button and the 'Cancel' link on this checkout page — here's the screenshot as a base64 PNG. Can you find the pixel coordinates and tell me how likely each element is actually visible?","exampleUseCases":[{"title":"Browser agent button clicking","prompt":"I'm automating a web form and need to find where to click the 'Next Step' button and the 'Skip for now' link in this screenshot — give me the pixel coordinates and confidence that each element is really there."},{"title":"GUI test automation element location","prompt":"I have a screenshot of our desktop app. Can you locate the 'File' menu, the 'Save As' button, and the close icon, and tell me their click coordinates and how visible each one is?"},{"title":"Fallback click target verification","prompt":"My browser automation agent is about to click 'Confirm Purchase' but I want to verify it's actually on screen first — here's the current page screenshot as a base64 JPEG, width 1280 and height 800. What are the coordinates and is it really visible?"}],"resultDescription":"Returns, for each requested UI element description: fractional coordinates (0–1 range relative to image dimensions), absolute pixel coordinates, and a probability score indicating how likely the element is actually visible in the screenshot. Enables precise, confidence-aware click targeting for GUI automation agents.","failureModes":["Image exceeds 2 MB limit — request rejected","Base64 encoding malformed or not a valid PNG/JPEG — parse error","More than 8 target descriptions provided — validation error","Element not visible in screenshot — returned with low probability score","Ambiguous element descriptions matching multiple regions — lower confidence scores","Incorrect width/height hints causing coordinate miscalculation"],"whenToPreferThis":"Use this endpoint when a computer-use or browser automation agent needs to visually ground UI element descriptions onto actual screenshot coordinates before clicking. Prefer it over DOM-based selectors when the agent cannot access the page's HTML (e.g., sandboxed browsers, desktop GUIs, remote screen captures). Ideal when you need both coordinates and a visibility confidence score to decide whether to proceed or re-try.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-21T07:20:56.436Z","isFirstParty":false,"canonicalSlug":"verdict-pointer-visual-ui-element-locator-a5c08729"}