{"uid":"cap_tKmWu73vLE8nmia8e-dgs","slug":"taifoon-chat-completions-llama-3-1-8b-instruct-9e1c4b02","name":"Taifoon Chat Completions – Llama 3.1 8B Instruct","description":"OpenAI-compatible chat completion on meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo, served by DeepInfra (serverless inference) and sold by Taifoon at the provider's price plus a 20 % reseller cut: 0.024 / 0.048 USD per 1M tokens in/out. This request is priced at its prompt and max_tokens. The answer is checked before you are charged.","url":"https://coord.taifoon.dev/v1/chat/completions/llama-3.1-8b-instruct?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","properties":{"model":{"type":"string","examples":["l3-8b-lunaris-v1","llama-3.1-8b-instruct","mistral-small-24b-instruct-2501","gemma-3-4b-it","gpt-oss-20b","phi-4","qwen2.5-7b-instruct","gemma-3-12b-it","qwen3.5-9b","gemma-3-27b-it","deepseek-v4-flash","ling-3.0-flash"],"description":"optional; one of the 76 models this wall delivers (GET lists them under terms.models); without it nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 answers"},"messages":{"type":"array","items":{"type":"object","required":["role","content"],"properties":{"role":{"enum":["system","user","assistant"],"type":"string"},"content":{"type":"string"}}},"maxItems":32,"minItems":1},"max_tokens":{"type":"integer","maximum":700,"minimum":1}}},"responseSchema":{"type":"json","example":{"id":"chatcmpl-gpu_…","model":"nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16","usage":{"total_tokens":28,"prompt_tokens":14,"completion_tokens":14},"object":"chat.completion","choices":[{"index":0,"message":{"role":"assistant","content":"17 × 24 = 408 (17 × 20 = 340; 17 × 4 = 68; 340 + 68 = 408)."},"finish_reason":"stop"}],"created":1791763200}},"example":null,"exampleRequest":null,"tags":["x402"],"displayCostAmount":"0.001512","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.0012/call","primary":{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.0012","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"x402","network":"base","amountUsd":"0.0012","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_3ajjBM71zpxg9n5Tajvgn","protocol":"x402","methodType":"crypto","chain":"base","mode":"charge","costAmount":"0.0012","costPer":"request","priority":0,"asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","unit":"request","depositMicros":null,"planRef":null}],"brandName":null,"brandSlug":null,"brandBaseUrl":null,"brandDocsUrl":null,"whatItDoes":"OpenAI-compatible chat completion endpoint serving llama-3.1-8b-instruct (and 70+ other models) via Taifoon's coordination layer, billed per call via x402.","exampleAgentPrompt":"Using Taifoon's chat API with llama-3.1-8b-instruct, answer this question in under 200 tokens: what are three practical tips for reducing household energy bills?","exampleUseCases":[{"title":"Agentic task reasoning with small LLM","prompt":"I need a quick reasoning step in my pipeline — use llama-3.1-8b-instruct to decide, given this context, whether the user's request is a refund or a complaint. Keep the answer under 50 tokens."},{"title":"On-demand Q&A for lightweight chatbot","prompt":"My chatbot needs to answer a customer question using Llama 3.1 8B: 'How do I reset my password if I no longer have access to my email?' Reply helpfully in under 150 tokens."},{"title":"Summarization with pay-per-call billing","prompt":"Summarize this paragraph into two sentences using llama-3.1-8b-instruct — I want to keep costs low so cap it at 100 tokens: 'Photosynthesis is the process by which green plants convert sunlight into chemical energy stored as glucose…'"}],"resultDescription":"A JSON object following the OpenAI chat completions schema: an `id`, `model`, `object` type, `created` timestamp, a `choices` array with the assistant's `message` (role + content) and `finish_reason`, and a `usage` object with prompt, completion, and total token counts.","failureModes":["Invalid or unsupported model name returns an error or falls back to default model","Missing x402 payment header results in 402 Payment Required with `get_key` instructions in response","messages array empty or missing required role/content fields returns 400 validation error","max_tokens exceeds 700 cap returns schema validation error","Network or GPU backend unavailability causes 5xx timeout","Sending more than 32 messages triggers maxItems validation failure"],"whenToPreferThis":"Choose this endpoint when you need a pay-per-call, OpenAI-compatible LLM inference API with no subscription or provisioning overhead, especially when you want access to Llama 3.1 8B or one of 70+ open-source models through a single URL, and you're operating in an x402-enabled agentic stack where USDC micropayments are acceptable. Prefer this over hosted OpenAI or Anthropic APIs when you want open-weight models at low per-call cost, and over self-hosted inference when you don't want to manage GPU infrastructure.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-11-20T12:40:43.741Z","isFirstParty":false,"canonicalSlug":"taifoon-chat-completions-llama-3-1-8b-instruct-9e1c4b02"}