{"uid":"cap_C88P-dWeQ56lNxU5DiUYn","slug":"diffbot-discussion-a8873db1","name":"Diffbot Discussion Extractor","description":"Extract threaded comments, reviews, and forum posts with authors, dates, and sentiment.","url":"https://diffbot.mpp.paywithlocus.com/diffbot/discussion?utm_source=zero.xyz","method":"POST","headers":{},"bodySchema":{"type":"object","required":["url"],"properties":{"url":{"type":"string","description":"URL of the discussion page"},"fields":{"type":"string","description":"Comma-separated extra fields to return (e.g. links, meta, breadcrumb)"},"paging":{"type":"boolean","description":"Follow pagination links"},"timeout":{"type":"number","description":"Request timeout in ms (default 30000)"},"maxPages":{"type":"number","description":"Max pages to follow (default 20)"},"discussion":{"type":"boolean","description":"Extract comments/discussion threads (default true for article)"}},"additionalProperties":true},"responseSchema":null,"example":{"request":{"url":"https://news.ycombinator.com/item?id=27000000","fields":"author,timestamp,text","paging":false,"timeout":30000,"maxPages":2,"discussion":true},"response":{"data":{"objects":[{"type":"discussion","posts":[{"id":0,"date":"Fri, 30 Apr 2021 22:05:27 GMT","html":"<p>&gt;The difficulty with ransomware attacks and the like, is that it's less a technical problem and more a people problem.</p>\n<p>The cause is <i>definitely technical</i>, it is a huge gaping hole in the design of modern operating systems that you could sail the Ever Given through <i>sideways</i> without incident.</p>\n<p>Your operating system does not confer to the user the ability to delegate only X resources to the opening of a file, email, etc. They (the users) have no ability to limit side effects. Blaming them for your bad system isn't ever going to help fix things.</p>\n<p>The missing system of limiting side effects is known as Capability Based Security. We all have a practical example of it in our wallet or purse. We can remove a unit of currency, hand it to someone else for a purchase, and that is the <i>maximum</i> we can lose, unless something extraordinary happens.</p>\n<p>We all have outlets, which limit the amount of power they will supply, and some even check to make sure it isn't supplied through us, or into a system that has arcing issues. We never have to worry that turning on a lamp will take down the power grid.</p>\n<p>Imagine if there were no circuit breakers or fuses, would blaming people for not being careful enough help make the system safer? No, of course not. Neither does blaming the user for your defective Operating System.</p>","text":">The difficulty with ransomware attacks and the like, is that it's less a technical problem and more a people problem.\nThe cause is definitely technical, it is a huge gaping hole in the design of modern operating systems that you could sail the Ever Given through sideways without incident.\nYour operating system does not confer to the user the ability to delegate only X resources to the opening of a file, email, etc. They (the users) have no ability to limit side effects. Blaming them for your bad system isn't ever going to help fix things.\nThe missing system of limiting side effects is known as Capability Based Security. We all have a practical example of it in our wallet or purse. We can remove a unit of currency, hand it to someone else for a purchase, and that is the maximum we can lose, unless something extraordinary happens.\nWe all have outlets, which limit the amount of power they will supply, and some even check to make sure it isn't supplied through us, or into a system that has arcing issues. We never have to worry that turning on a lamp will take down the power grid.\n\nImagine if there were no circuit breakers or fuses, would blaming people for not being careful enough help make the system safer? No, of course not. Neither does blaming the user for your defective Operating System.","type":"post","title":">The difficulty with ransomware attacks and the like, is that it's less a technical problem and more a people problem.","author":"mikewarot","pageUrl":"https://news.ycombinator.com/item?id=27000000","authorUrl":"https://news.ycombinator.com/user?id=mikewarot","diffbotUri":"post|3|974244203","humanLanguage":"en"},{"id":1,"date":"Sat, 01 May 2021 05:07:29 GMT","html":"<p>&gt; We all have outlets, which limit the amount of power they will supply, and some even check to make sure it isn't supplied through us, or into a system that has arcing issues.</p>\n<p>Not that you don't have a point, but outlet safety measures only address <i>accidental</i> failures. A malicous device is perfectly capable of storing power in a battery or capacitor to exceed instantaneous power limits, or running at 12 amps (out of 15A fuses) 24/7 to pull much more power than you expect over time, or electrocuting you taser-style even if it doesn't have a high-current ground path. So while the safety features are <i>useful</i>, they're not particularly relevant to <i>security</i>.</p>\n<p>The wallet example is pretty good, though, as is your actual point.</p>","text":"> We all have outlets, which limit the amount of power they will supply, and some even check to make sure it isn't supplied through us, or into a system that has arcing issues.Not that you don't have a point, but outlet safety measures only address accidental failures. A malicous device is perfectly capable of storing power in a battery or capacitor to exceed instantaneous power limits, or running at 12 amps (out of 15A fuses) 24/7 to pull much more power than you expect over time, or electrocuting you taser-style even if it doesn't have a high-current ground path. So while the safety features are useful, they're not particularly relevant to security.\n\nThe wallet example is pretty good, though, as is your actual point.","type":"post","author":"a1369209993","pageUrl":"https://news.ycombinator.com/item?id=27000000","authorUrl":"https://news.ycombinator.com/user?id=a1369209993","diffbotUri":"post|3|-375905574","humanLanguage":"en"},{"id":2,"date":"Sat, 01 May 2021 02:10:57 GMT","html":"<p>Curious, what are the viable capability based systems within the next decade or so? Fuschia?</p>","text":"Curious, what are the viable capability based systems within the next decade or so? Fuschia?","type":"post","author":"fancyfish","pageUrl":"https://news.ycombinator.com/item?id=27000000","authorUrl":"https://news.ycombinator.com/user?id=fancyfish","diffbotUri":"post|3|-370291399","humanLanguage":"en"},{"id":3,"date":"Sat, 01 May 2021 13:25:16 GMT","html":"<p>This.</p>\n<p>Wondering how we're going to remember the times before proper capability based security systems go mainstream...</p>","text":"This.\n\nWondering how we're going to remember the times before proper capability based security systems go mainstream...","type":"post","author":"goodthenandnow","pageUrl":"https://news.ycombinator.com/item?id=27000000","authorUrl":"https://news.ycombinator.com/user?id=goodthenandnow","diffbotUri":"post|3|-1387144352","humanLanguage":"en"}],"title":">The difficulty with ransomware attacks and the like, is that it's less a technical problem and more a people problem.","pageUrl":"https://news.ycombinator.com/item?id=27000000","numPages":1,"numPosts":4,"confidence":0.0850000026822095,"diffbotUri":"discussion|3|-957635353","participants":4,"humanLanguage":"en"}],"request":{"api":"discussion","fields":"author,timestamp,text","options":["discussion=true","maxPages=2","paging=false","timeout=30000"],"pageUrl":"https://news.ycombinator.com/item?id=27000000","version":3}},"success":true}},"exampleRequest":{"url":"https://news.ycombinator.com/item?id=27000000","fields":"author,timestamp,text","paging":false,"timeout":30000,"maxPages":2,"discussion":true},"tags":["web-scraping","extraction","articles","products","web","data"],"displayCostAmount":"0.0042","displayCostAsset":"USDC","priceDynamic":false,"priceHint":null,"priceStatus":"priced","priceSource":"settled","requiresHandshake":false,"reviewCount":0,"rating":{"score":"0.00","successRate":"0.00","reviews":0,"stars":null,"state":"unrated"},"availabilityStatus":"unknown","priceObserved":null,"sessionDeposit":null,"pricing":{"kind":"static","summary":"$0.0042/call","primary":{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.0042","per":"call","confidence":"exact"},"accepted":[{"kind":"static","protocol":"mpp","network":"tempo","amountUsd":"0.0042","per":"call","confidence":"exact"}]},"paymentMethods":[{"uid":"pm_yxGg7pjyv7w5yTsLy05_3","protocol":"mpp","methodType":"crypto","chain":"tempo","mode":"charge","costAmount":"0.0042","costPer":"request","priority":0,"asset":"0x20c000000000000000000000b9537d11c60e8b50","unit":"request","depositMicros":null,"planRef":null}],"brandName":"Diffbot","brandSlug":"diffbot","brandBaseUrl":"https://www.diffbot.com","brandDocsUrl":"https://docs.diffbot.com","whatItDoes":"Extracts structured comment threads and discussion posts from web forum, news comment, and discussion pages","exampleAgentPrompt":"Extract all the discussion posts and comments from this Hacker News thread — https://news.ycombinator.com/item?id=28000000 — including author, timestamp, and post text, following pagination up to 3 pages.","exampleUseCases":null,"resultDescription":"Returns a structured array of discussion post objects, each containing post ID, author, timestamp, HTML content, plain text, post type, and threading metadata extracted from the target discussion page.","failureModes":["URL is not a discussion or forum page — returns empty posts array","Target page blocks scraping or requires authentication — returns access error","Pagination limit exceeded — returns only pages up to maxPages","Timeout exceeded on slow or large pages — returns partial data or timeout error","Malformed URL input — returns validation error"],"whenToPreferThis":"Use this endpoint when you need to extract structured comment threads or discussion posts from a specific URL — particularly forums, Hacker News, Reddit-style threads, or news comment sections. Prefer this over the Article endpoint when the primary content is community discussion rather than editorial text, and over generic scraping tools when you need post-level structure (author, timestamp, HTML/text per post).","instructions":null,"reviewSummary":null,"reviewSummaryHighlights":null,"reviewSummaryConcerns":null,"reviewSummaryGeneratedAt":null,"activationCount":0,"lastUsedAt":null,"lastSuccessfullyRanAt":null,"lastHealthCheckAt":"2026-10-11T12:32:20.460Z","isFirstParty":false,"canonicalSlug":"diffbot-discussion-a8873db1"}