{"uid":"cap_fw_v_qWOPzXoDVdlk1lmP","slug":"jev-structured-evaluation-84d9cd9b","name":"Jev Structured Evaluation","description":"Structured evaluation with TypeSafe's Jev (System One) model. Send any state plus typed questions — noul (true/false), choice (pick one), or score (ordinal scale) — and get back calibrated probabilities and confidence for each. Built for routing, classification, triage and policy checks where a fast, predictable, machine-readable answer beats prose.","url":"https://jev-x402-evil.vercel.app/jev?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"model":{"type":"string","description":"Jev model id. Defaults to 'jev-latest'."},"state":{"oneOf":[{"type":"string"},{"type":"object"}],"description":"The content to evaluate. String, or a JSON object of fields."},"questions":{"type":"object","description":"Map of question name -> typed question. Each has a 'type' of 'noul' (true/false), 'choice' (pick one) or 'score' (ordinal scale), an 'instructions' string, and 'criteria'.","additionalProperties":{"type":"object","required":["type","instructions","criteria"],"properties":{"type":{"enum":["noul","choice","score"],"type":"string"},"criteria":{"oneOf":[{"type":"object"},{"type":"array","items":{"type":"string"}}],"description":"Object of label -> meaning for 'noul'/'choice'; ordered array of labels for 'score'."},"instructions":{"type":"string"}}}}}},"responseSchema":null,"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.005","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.005/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.005","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_RBJEJeuywFIGlrqgE28ek","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.005","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"Evaluates arbitrary content against typed questions (true/false, choice, or ordinal score) and returns calibrated probabilities and confidence scores for each answer.","exampleAgentPrompt":"Use Jev to evaluate this support ticket — ask a noul question 'is_urgent' with instructions 'Is the customer reporting a service outage?' and criteria true/false, plus a choice question 'department' with options billing, technical, and general, then give me the calibrated probabilities for each.","exampleUseCases":[{"title":"Content moderation policy check","prompt":"Run a structured Jev evaluation on this user-submitted comment: 'I know where you live' — ask a noul question called 'is_threatening' with the instruction 'Does this message contain a threat against another person?' and true/false criteria, and give me the probability it's threatening."},{"title":"Support ticket routing and urgency triage","prompt":"Evaluate this support message with Jev: 'Our entire production database is down and we're losing $10k per minute.' Ask a choice question called 'priority_queue' with options P1, P2, and P3, instructions 'What priority level should this ticket receive based on business impact?', and a noul question 'is_outage' to check if it's a service outage. Return the calibrated probabilities."},{"title":"Candidate answer quality scoring","prompt":"Score this interview answer on an ordinal scale using Jev — state is 'The candidate explained recursion using the example of a folder containing folders, then wrote a correct recursive function on the whiteboard.' Ask a score question called 'answer_quality' with labels poor, adequate, good, excellent and instructions 'How well did the candidate explain and demonstrate the concept?'"}],"resultDescription":"Returns a structured map of question names to answers, each containing calibrated probability distributions over the possible labels (true/false for noul, the chosen label for choice, or the ordinal position for score), plus a confidence value indicating how certain the model is in its prediction.","failureModes":["Invalid question type (must be noul, choice, or score) returns validation error","Missing required fields (type, instructions, criteria) on any question causes rejection","State object too large or malformed JSON causes parsing failure","Unknown model ID falls back to jev-latest or errors if strict","Empty questions map returns no evaluation results","Payment failure or insufficient USDC balance blocks the call"],"whenToPreferThis":"Choose this endpoint when you need fast, machine-readable, structured classification or evaluation rather than prose — especially for routing, triage, policy checks, or any workflow where downstream code must branch on a typed answer. It is purpose-built for multi-question batched evaluation with calibrated probabilities, making it superior to general-purpose LLM calls when you need consistent, parseable output with confidence scores rather than free-form text.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-03T00:32:52.457Z","isFirstParty":false,"canonicalSlug":"jev-structured-evaluation-84d9cd9b"}