Reference & Lookup Data · Integration
Diffbot
Add Diffbot to your product for your customers, and give your AI agents governed access to it.
Diffbot has two distinct surfaces that behave differently. The Automatic APIs at api.diffbot.com/v3 (analyze, article, product, discussion) take the target page as a url query parameter and the credential as a token query parameter rather than an Authorization header, which trips up anyone wiring it through a standard HTTP client that only injects headers. The Knowledge Graph at kg.diffbot.com/kg/v3/dql is a separate query language over entities such as Organization, Person and Article, returning hydrated entity records rather than scraped page output. The Crawl API is job-based: you name a job, poll it, and read results separately, so nothing about it fits a request-response call pattern. Billing is per credit and per token, and the token is the only thing separating one customer's usage from another's, so it must never be shared across tenants. fastn holds each customer's own token, keeps the credential refreshed, and tracks which tenant spent which credits.
In your product
Embedded for your customers. Per-tenant auth, no per-customer code, maintained by fastn.
Let a customer connect their own Diffbot token so your product enriches company records they paste in without you fronting the credits
Resolve a list of supplier websites to Knowledge Graph Organization entities and write industry, headcount and location back into your own schema
Turn a submitted URL into a clean article record with author, publication date and body text for a content monitoring feature
Run a crawl job over a customer's competitor sites and surface product records with price and availability changes
For your AI agents
Governed, audited access for the agents you build, through the MCP server.
Let an agent look up an Organization in the Knowledge Graph before it drafts an account summary, with every lookup audited per tenant against that tenant's own token and credit balance
Have an agent extract the structured article record from a URL a user pasted, rather than guessing at page content
Allow an agent to check a crawl job's progress and report which pages returned usable product records
Example prompt
Look up Diffbot's Knowledge Graph entry for stripe.com and tell me the headcount and industry it reports.
Set up Diffbot in 4 steps
- 01Enable the Diffbot connector from your fastn dashboard.
- 02Have each customer authorise their own Diffbot account, so calls run under their credentials rather than a shared key.
- 03Decide which lookups, results and reports your product needs, map those fields, then enable the actions and triggers you want.
- 04Call it from your product and expose it to your agents through the same governed connection.
Why teams use the Diffbot integration
What you get by embedding it with fastn instead of building it yourself.
- Ship a Diffbot integration without building it. Your customers connect their own Diffbot account inside your product and work their lookups, results and reports there, with no per-customer code on your side.
- Handle the part that actually costs time: these are metered read sources, so an uncached lookup on every page view burns the customer's allowance. fastn owns the auth, token refresh, rate limits, pagination and breaking-change fixes, so a Diffbot update is not your on-call problem.
- One integration serves your product and your agents. The same governed Diffbot connection powers in-product features and gives AI agents scoped, audited access, so you answer questions from an authoritative outside source without holding that data yourself without wiring it twice.
Used by these teams
Compare with
Often used alongside
Tools the same teams tend to run next to Diffbot, across other categories.
Diffbot integration FAQ
How do I add a Diffbot integration to my product?
Enable the Diffbot connector in your fastn dashboard, then let each customer authenticate their own Diffbot account. fastn handles the OAuth flow, token storage and refresh per tenant, so there is no Diffbot client code in your app and no per-customer branch in your codebase. Setup is 4 steps.
Do my customers each connect their own Diffbot account?
Yes. Every connection is scoped to the individual customer, so each authorises their own Diffbot account and only ever sees their own lookups, results and reports. That per-tenant isolation is the point of an embedded integration: you support the long tail of customer setups without maintaining an integration per customer.
Can AI agents use this Diffbot integration?
Yes. The same connection is exposed to your agents through the fastn MCP gateway, with permissions scoped per tenant and every call audited. Let an agent look up an Organization in the Knowledge Graph before it drafts an account summary, with every lookup audited per tenant against that tenant's own token and credit balance
Who maintains the Diffbot integration?
fastn does. When Diffbot changes an endpoint, deprecates a field or alters its auth, the fix lands in the connector rather than in your backlog, and your customers' connections keep working.
Whose credentials does a Diffbot lookup run under?
Each customer's own. Quota and cost land on the customer that caused them rather than on a shared key you have to meter and re-bill, and one heavy customer cannot exhaust another's allowance.
How should Diffbot results be cached?
Per tenant, with a window that matches how fast the underlying data actually moves. Diffbot is a read source rather than a system of record, so the same query returns the same answer until the source changes, and caching is the difference between a sustainable integration and one that exhausts a customer's allowance on a busy page.
What can I build with the Diffbot integration?
A common starting point: let a customer connect their own Diffbot token so your product enriches company records they paste in without you fronting the credits. Teams also use it for the other use cases listed above, and expose it to agents for governed reads and writes.
How much does the Diffbot integration cost?
It is included. Pricing is based on connected accounts, not on how many connectors you enable, so adding Diffbot does not change your per-connector cost. You can start free with 3 connected accounts.
Add Diffbot to your product
Start free with 3 connected accounts. No sales call required, and no per-customer integration code.