{"uid":"cap_-d3XCIXl5km5hkcJ_Bdej","slug":"agents-forwardlane-com-get-benchmark-task-2407073b","name":"Get Benchmark Task","description":"Full record of one benchmark task.\n\nReturns the catalog metadata plus ``problem_statement``, ``base_commit``,\n``environment_setup_commit``, the gold ``patch`` (unified diff) and the\n``FAIL_TO_PASS`` / ``PASS_TO_PASS`` test lists in SWE-bench format.","url":"https://agents.forwardlane.com/api/benchmark/tasks/{instance_id}?utm_source=zero.xyz","method":"GET","headers":{},"bodySchema":{"type":"object","required":["instance_id"],"properties":{"instance_id":{"type":"string","title":"Instance Id","description":"Task instance id"}}},"responseSchema":{"type":"object","additionalProperties":true},"example":null,"exampleRequest":null,"tags":[],"displayCostAmount":"10","displayCostAsset":"USD","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"probe","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$10/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"10","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"10","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_DoMnMITEdhudt8GVgG2kP","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"10","costPer":"request","priority":0,"asset":"usd","unit":"request","depositMicros":null,"planRef":null}],"brandName":"agents.forwardlane.com","brandSlug":"agents-forwardlane-com-x402","brandBaseUrl":"https://agents.forwardlane.com","brandDocsUrl":null,"whatItDoes":"Retrieves a single SWE-bench style benchmark task instance by its unique instance ID from ForwardLane's financial-services code evaluation dataset.","exampleAgentPrompt":"Pull up the ForwardLane benchmark task with instance ID 'django__django-11001' so I can see the full task specification and evaluation details.","exampleUseCases":[{"title":"Inspect failing evaluation task","prompt":"I need to see the full details of benchmark task instance 'sqlfluff__sqlfluff-4205' — pull it up from ForwardLane so I can understand what the task is asking and how it's structured."},{"title":"Review financial code challenge","prompt":"Fetch the SWE-bench benchmark task with instance ID 'pandas-dev__pandas-39853' from ForwardLane's platform so I can check what code changes are expected."},{"title":"Audit specific model evaluation input","prompt":"Get me the benchmark task instance 'scikit-learn__scikit-learn-13497' from ForwardLane — I want to verify what the task specification looks like before comparing it against our model's output."}],"resultDescription":"Returns a JSON object representing a single SWE-bench style benchmark task instance, including task specification, instance metadata, expected code changes, repository context, and evaluation criteria relevant to financial-services codebases. The response schema allows additional properties, so the full payload may include rich contextual fields.","failureModes":["Invalid or non-existent instance_id returns a 404 or error response","Missing required instance_id path parameter causes a 422 validation error","Payment failure (402) if the $10 per-call fee cannot be processed","Network timeout if the FL Repos Intelligence platform is temporarily unavailable","Malformed instance_id format may result in an empty or null response"],"whenToPreferThis":"Use this endpoint when you have a specific benchmark task instance_id and need the complete details of that single task. Prefer this over the List Benchmark Tasks endpoint when you already know the exact instance you want to inspect, need the full task payload rather than a summary list, or are comparing a model's solution against a specific evaluation challenge in ForwardLane's financial-services repository dataset.","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-22T00:43:08.187Z","isFirstParty":false,"canonicalSlug":"agents-forwardlane-com-get-benchmark-task-2407073b"}