> ## Documentation Index
> Fetch the complete documentation index at: https://www.octoparse.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Octoparse Data Hub

> Turn scraping, existing datasets, and third-party APIs into standardized Data Apps that AI agents, scripts, and business systems can call on demand.

Octoparse Data Hub turns a data capability into something software can call. Scraping templates, scraping scripts, existing databases, third-party APIs, and processing programs all get wrapped in one shape: the **Data App**. A person can run one in the browser. An agent can find one, read its contract, and call it without anyone writing glue code.

<Card title="Open Octoparse Data Hub" href="https://www.octoparse.com/data-hub">
  See what is live today and filter by capability, industry, platform, and content type.
</Card>

## Why Data Hub

Data products used to be built for people to read. You opened a site, downloaded a report, and cleaned up the result by hand. An agent cannot do any of that. It needs something it can call with structured arguments, a description it can parse on its own, and a price it can be billed for by usage.

That is the gap Data Hub fills. You stop shopping for a vendor per source, writing a scraper per site, and adapting to a new interface per API. Every capability is discovered and called the same way, whether a person or an agent is driving it.

## How Data Hub works

<img src="https://mintcdn.com/octoparse/wgl_xBQG90UAi4tn/images/datahub/standardized-data-app-flow.svg?fit=max&auto=format&n=wgl_xBQG90UAi4tn&q=85&s=ca772cd73c5d648f635154a43bf70c67" alt="Scraping templates, scripts, datasets, third-party APIs, and processing programs are wrapped as Data Apps, then served to agents, business systems, and people through the web portal, API, MCP, or SDK" width="1265" height="710" data-path="images/datahub/standardized-data-app-flow.svg" />

The source underneath can be a scraper, a dataset you already own, a partner API, or a cleaning routine. Callers never see the difference. That is the point: the catalog can keep growing while the integration you wrote last quarter keeps working.

## What is a Data App

A Data App is one callable capability. Enrich a company name with firmographics, pull reviews for a product URL, fetch the details behind a video link, normalize a block of messy text. Each of those is packaged, priced, and versioned on its own.

<img src="https://mintcdn.com/octoparse/wgl_xBQG90UAi4tn/images/datahub/data-app-anatomy.svg?fit=max&auto=format&n=wgl_xBQG90UAi4tn&q=85&s=fb87c59515714dba2e254cb79dca45e6" alt="A Data App carries a publisher and app name, a machine-readable spec, input and output fields, a public price, and a run-it-now entry point" width="1265" height="665" data-path="images/datahub/data-app-anatomy.svg" />

| Element                           | What it gives you                                                                                              |
| --------------------------------- | -------------------------------------------------------------------------------------------------------------- |
| **Publisher / app name**          | A stable identifier. You always know which capability and whose implementation you are calling.                |
| **Machine-readable spec**         | Purpose, arguments, returned fields, and the limits of the capability, in a form an agent parses without help. |
| **Structured in, structured out** | Typed arguments go in, typed records come back. No HTML, no scraping on your side.                             |
| **Run it now**                    | Sign in and run real data on the detail page before you commit any code to it.                                 |
| **Public price**                  | Billing rules sit on the detail page. You pay for what the app actually returns.                               |

## Who uses it

<CardGroup cols={2}>
  <Card title="Teams that consume data">
    Agent and application builders, analysts, growth and e-commerce teams, and engineers who need outside data inside their own systems. Find a capability, try it in the browser, wire it into whatever you already run.
  </Card>

  <Card title="Teams that publish data">
    The Octoparse data team, plus companies and developers sitting on data assets, collection know-how, or processing pipelines. Wrap a capability as a Data App, set a price, and serve callers under platform rules.
  </Card>
</CardGroup>

Publishing review, visibility controls, content governance, and category upkeep keep the catalog worth searching.

## What people build with it

<CardGroup cols={2}>
  <Card title="Lead enrichment">
    Hand your agent a list of company names and get industry, headcount, and headquarters back, straight into the CRM record or the outbound sequence.
  </Card>

  <Card title="Competitor price tracking">
    Watch listings, promotions, and stock status on a schedule, then feed a pricing dashboard or a repricing rule.
  </Card>

  <Card title="Search visibility">
    Pull ranked results for the queries you care about and track how position, snippets, and competitors move over time.
  </Card>

  <Card title="Review and reputation analysis">
    Collect reviews across marketplaces and local listings, then run sentiment and theme extraction on top of them.
  </Card>

  <Card title="Talent and hiring research">
    Track public job postings to read demand by role, seniority, and region before you plan headcount or pricing.
  </Card>

  <Card title="Tools for your own agent">
    Register the apps your workflow needs, and let the agent decide when to call them mid-conversation or mid-task.
  </Card>
</CardGroup>

## Four ways in

<img src="https://mintcdn.com/octoparse/wgl_xBQG90UAi4tn/images/datahub/datahub-access-methods.svg?fit=max&auto=format&n=wgl_xBQG90UAi4tn&q=85&s=5c767ad4dc13d1c1dabb5e704690deb1" alt="Data Hub is reachable four ways: the web portal, the REST API, MCP, and the official SDKs" width="1265" height="633" data-path="images/datahub/datahub-access-methods.svg" />

<CardGroup cols={2}>
  <Card title="Web portal" href="/docs/en/datahub/quick-start/client-use">
    Where evaluation starts. Browse, read the contract, run it, and check or export the result in the console.
  </Card>

  <Card title="API">
    For teams with engineers. An API key and standard endpoints put records straight into your systems and pipelines.
  </Card>

  <Card title="MCP" href="/docs/en/datahub/quick-start/agent-connection/general">
    For anyone working through an agent. Connect once and let it search, or pin a single app as a fixed tool.
  </Card>

  <Card title="SDK">
    For fast integration. The official packages handle auth, polling, and paging so you write the business logic only.
  </Card>
</CardGroup>

Same account, same catalog, same results behind all four. Pick the one that matches how you already work.

<Card title="Data Hub MCP capabilities" href="/docs/en/datahub/mcp-capabilities">
  The six tools of the general MCP server, synchronous versus asynchronous runs, result paging, and how oversized results get handed off for export.
</Card>

## What it costs

You browse and read for free, and pay only when a call actually returns data. Each publisher sets the rules, published on the app's detail page. Three patterns cover almost everything:

* **Base fee**: a flat charge per submitted run, independent of how many records come back.
* **Per record**: charged on records returned successfully, sometimes bundled into blocks of a fixed size.
* **Custom unit**: whatever unit fits the capability, such as a minute of audio.

A failed run costs nothing. A partial run bills only the records it delivered. Charges come out of your account balance, and new calls stop when the balance runs out. Usage and invoices live in the Open Platform console.

## Getting started

<Steps>
  <Step title="Pin down what you need">
    The business question, the sources, the fields, and how fresh the data has to be.
  </Step>

  <Step title="Find the app">
    Search <a href="https://www.octoparse.com/data-hub" target="_blank" rel="noopener noreferrer">Octoparse Data Hub</a> and read the capability description, the arguments, the returned fields, and the price.
  </Step>

  <Step title="Run it once">
    Sign in, fill in the arguments, and run. Confirm the records look like what you expected before writing any code.
  </Step>

  <Step title="Wire it in">
    Move downstream through the portal, the API, MCP, or an SDK, whichever fits your stack.
  </Step>
</Steps>

<Note>
  Data Hub is a catalog of callable data capabilities. The Octoparse MCP Server is a different product that runs scraping templates and cloud tasks on your own account, documented under <a href="/docs/en/mcp/index" target="_blank" rel="noopener noreferrer">MCP Server</a>. To try an app right now, read <a href="/docs/en/datahub/quick-start/client-use" target="_blank" rel="noopener noreferrer">Run a Data App in the browser</a>. If you have not picked one yet, start with <a href="/docs/en/datahub/quick-start/agent-connection/general" target="_blank" rel="noopener noreferrer">General connection</a>. If you already know which app you want, go to <a href="/docs/en/datahub/quick-start/agent-connection/codex" target="_blank" rel="noopener noreferrer">Codex</a> or <a href="/docs/en/datahub/quick-start/agent-connection/claude-code" target="_blank" rel="noopener noreferrer">Claude Code</a>.
</Note>
