{"uid":"cap_ZktCVifDPpZdIn29LEh7H","slug":"jev-structured-evaluation-0fef3fd4","name":"Jev Structured Evaluation","description":"Structured evaluation with TypeSafe's Jev (System One) model. Send any state plus typed questions — noul (true/false), choice (pick one), or score (ordinal scale) — and get back calibrated probabilities and confidence for each. Built for routing, classification, triage and policy checks where a fast, predictable, machine-readable answer beats prose.","url":"https://jev-x402.vercel.app/jev?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"model":{"type":"string","description":"Jev model id. Defaults to 'jev-latest'."},"state":{"oneOf":[{"type":"string"},{"type":"object"}],"description":"The content to evaluate. String, or a JSON object of fields."},"questions":{"type":"object","description":"Map of question name -> typed question. Each has a 'type' of 'noul' (true/false), 'choice' (pick one) or 'score' (ordinal scale), an 'instructions' string, and 'criteria'.","additionalProperties":{"type":"object","required":["type","instructions","criteria"],"properties":{"type":{"enum":["noul","choice","score"],"type":"string"},"criteria":{"oneOf":[{"type":"object"},{"type":"array","items":{"type":"string"}}],"description":"Object of label -> meaning for 'noul'/'choice'; ordered array of labels for 'score'."},"instructions":{"type":"string"}}}}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.001","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":1,"rating":{"score":"0.92","successRate":"1.00","reviews":1,"stars":"4.7","state":"rated"},"availabilityStatus":"healthy","priceObserved":{"p10Cents":"0.1000","medianCents":"0.1000","p90Cents":"0.1000","minCents":"0.1000","maxCents":"0.1000","p95Cents":"0.1000","sampleCount":2,"varies":false,"failureChargeRate":null},"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.001/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.001","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.001","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_utFpVFfPY-YvGMnGfRHXD","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.001","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Evaluates arbitrary content against typed questions (true/false, single-choice, or ordinal score) and returns calibrated probabilities and confidence scores for each answer.","exampleAgentPrompt":"Evaluate this support ticket using Jev's structured evaluation: check if it's urgent (true/false), classify the department as one of 'billing', 'technical', or 'general', and score the sentiment on a scale of 'negative', 'neutral', 'positive' — the ticket reads: 'My account was charged twice this month and I still can't log in, this is unacceptable.'","exampleUseCases":[{"title":"Content policy triage for agent pipeline","prompt":"Run a structured Jev evaluation on this user message to check: (1) does it violate our content policy — true or false; (2) classify its intent as one of 'spam', 'abuse', 'legitimate', or 'unclear'; (3) score its toxicity as 'low', 'medium', or 'high'. The message is: 'Click here to claim your free prize, limited time only!'"},{"title":"Lead qualification scoring","prompt":"Use Jev to evaluate this sales lead JSON — I need to know: is the company in our target ICP (true or false), which tier they fall into ('enterprise', 'mid-market', or 'SMB'), and how strong the buying signal is on a scale of 'weak', 'moderate', or 'strong'. Here's the lead: {\"company\":\"Acme Corp\",\"employees\":450,\"industry\":\"SaaS\",\"last_activity\":\"requested a demo\"}"},{"title":"AI response quality check","prompt":"Evaluate this AI-generated answer against our quality rubric using Jev: first, does it directly answer the question asked — true or false; second, pick the best label for its tone — 'formal', 'neutral', or 'conversational'; third, score its factual completeness as 'incomplete', 'partial', or 'complete'. The answer is: 'The capital of France is Paris, a major European city known for the Eiffel Tower.'"}],"resultDescription":"Returns a structured JSON object keyed by question name, where each value contains the evaluated label, calibrated probability distribution over all possible answers, and a confidence score. Designed to be machine-readable for downstream routing, gating, or logging logic.","failureModes":["Invalid question type (not 'noul', 'choice', or 'score') returns a validation error","Missing required 'instructions' or 'criteria' fields per question causes rejection","Malformed or empty 'state' may produce low-confidence or error responses","Payment not included or insufficient USDC triggers x402 payment-required response","Model ID not found if a non-existent 'model' string is provided"],"whenToPreferThis":"Choose this endpoint when you need fast, structured, machine-readable classification or evaluation over freeform text or JSON state — especially for routing, triage, policy checks, or quality scoring where calibrated probabilities matter more than prose explanations. It outperforms general LLM prompting for tasks requiring type-safe, multi-question evaluation in a single call with consistent output format.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":2,"lastUsedAt":"2026-10-11T21:54:45.407Z","lastSuccessfullyRanAt":"2026-10-11T21:54:45.407Z","lastHealthCheckAt":"2026-10-12T21:56:03.084Z","isFirstParty":false,"canonicalSlug":"jev-structured-evaluation-0fef3fd4"}