Search Data Hub content with a phrase and filters, then return matching page records with source metadata and content text.
Web Search Rerank
Search the web from a natural-language request and return relevance-ranked webpage results with content and source metadata
Overview
Web research often starts with a question rather than a known page. This Data App turns a natural-language request into a relevance-ranked set of webpages, preserving the page text, concise summaries, source identity, and publication context needed for analysis.
It is useful for quickly building a research set around a company, product, topic, or event. Freshness and domain filters help focus the search, while account, organization, and search-role filters can narrow the results when those source attributes are available.
Data notes
Each row represents one webpage returned for the submitted search question. Page URL is used to identify a result and remove duplicates. The result set covers webpage records only; a separate image collection returned by the source is not included here.
Page content may be empty even when a title, snippet, or summary is available. Account name, organization name, site icon, cached URL, language, and family-friendly or navigational flags may also be unavailable for individual pages. Publication and crawl timestamps are preserved as source text without inferring a timezone.
What the results look like
Each row is one relevance-ranked webpage result.
| Page URL | Page title | Site name | Published at | Snippet |
|---|---|---|---|---|
| https://www.example.com/article/123 | Xiaomi car delivery momentum continues to rise | Example Site | 2026-08-05 14:23:10 | Xiaomi car deliveries have continued to grow. |
Additional values include the full page content, summary, display and cached URLs, account and organization names, language, source identifiers, and crawl time.
Use cases
- Build a research set for a company, product, market, or event by combining Page title, Page content, Snippet, and Summary.
- Monitor recent coverage by pairing a Freshness filter with Published at and Last crawled at.
- Compare source visibility by grouping results by Site name, Account name, or Organization name.
- Preserve traceable source links by using Page URL and Display URL when reviewing or exporting results.
Scope and boundaries
Each run accepts one natural-language search request and returns up to 200 relevance-ranked webpage records in one response. Separate image results are not included.
- Good for
- When you need relevance-ranked webpage results for a natural-language research question
- When you need webpage titles, summaries, content, source metadata, and publication timestamps in a structured result set
- When you want to narrow web search by freshness, domains, account, organization, or search role
- Do not use for
- When you need image-only results or a dedicated image search dataset
- When you need private, login-only, or non-public webpage content
Failure handling
Failure and retry behavior declared by the developer. We recommend including it in your system prompt when integrating.
- 1If no useful webpages are returned, broaden the query or remove restrictive domain and freshness filters
- 2Retry later after rate limiting, temporary service unavailability, or a timeout
- 3If authentication fails, verify the API Key configured for the execution environment
Input
Parameters required to call this App, generated from the input.schema in manifest.json.
- Search question
queryRequiredstringThe natural-language topic or question to search. Provide at least one character; clearer wording produces more focused results.ExampleXiaomi car delivery and sales performance - Result count
countOptionalintegerThe number of webpage results to request. The default is 10 and the allowed range is 1 to 200; fewer results may be available for a narrow query.Range1–200Default10 - Freshness filter
freshnessOptionalstringLimits results by recency. Use noLimit, oneDay, oneWeek, oneMonth, oneYear, a date such as 2026-08-05, or a date range such as 2026-08-01..2026-08-31. The default is noLimit.DefaultnoLimit - Included domains
includeOptionalstringSearch only the listed domains. Separate up to 100 domain values with | or commas, using domain values supplied by the Data Hub domain list. - Excluded domains
excludeOptionalstringExclude the listed domains from the search. Separate up to 100 domain values with | or commas, using domain values supplied by the Data Hub domain list. - Account name
account_nameOptionalstringFilters results to an exact account name when the source identifies one. Leave empty to search without an account filter. - Organization name
office_nameOptionalstringFilters results to an exact organization name when the source identifies one. Leave empty to search without an organization filter. - Search role
role_codeOptionalstringUses a configured Data Hub search role, such as WEB_SEARCH. Leave empty to use the system default role.
Output
Field structure of a single record, generated from the output.schema in manifest.json.
- Account name
account_namestringThe account name associated with the webpage when available.ExampleChina News Network - Cached page URL
cached_page_urlstringThe cached webpage URL when available. - Page content
contentstringThe webpage body content when available. It is independent from the snippet and summary and may be empty.ExampleXiaomi car deliveries have continued to grow, with stronger showroom traffic and steady delivery scheduling. - Last crawled at
date_last_crawledstringThe source timestamp of the latest crawl, preserved as returned without timezone conversion.Example2026-08-05 15:00:00
Sample data
Generated from output.schema. Fields without a sample value use structural placeholders.
{
"account_name": "China News Network",
"cached_page_url": "<cached_page_url>",
"content": "Xiaomi car deliveries have continued to grow, with stronger showroom traffic and steady delivery scheduling.",
"date_last_crawled": "2026-08-05 15:00:00",
"date_published": "2026-08-05 14:23:10",
"display_url": "https://www.example.com/article/123",
"id": "0",
"is_family_friendly": false,
"is_navigational": false,
"language": "en",
"name": "Xiaomi car delivery momentum continues to rise",
"office_name": "<office_name>",
"site_icon": "<site_icon>",
"site_name": "Example Site",
"snippet": "Xiaomi car deliveries have continued to grow.",
"summary": "Xiaomi car deliveries have continued to grow, with stronger showroom traffic and steady delivery scheduling.",
"url": "https://www.example.com/article/123"
}Integration
This App can be integrated via MCP, API, SDK, or file export. All channels share the same capabilities and pricing. Every request authenticates with the Authorization: Bearer header using an API key (long-lived, created in the Data Hub Console); MCP clients can also sign in with OAuth, no key required. More options such as CLI and Skill are on the way.
With the MCP (Model Context Protocol), you can call this App directly from AI clients like Claude and Cursor. Pick your client and auth mode, then copy the config below.
Client config
Replace the value after Bearer with your long-lived API key. Works in any client, CI, or headless environment.
{
"mcpServers": {
"octoparse_datahub": {
"type": "http",
"url": "https://mcp-v2.octoparse.com?pin=meme_today/data-hub-web-search-rerank",
"headers": { "Authorization": "Bearer <YOUR_API_KEY>" }
}
}
}Let AI set it up for you
Don't want to edit configs by hand? Copy the install prompt and paste it into any AI client. It will complete the setup its own way. (By default it guides you through signing in, and never asks you to send your API key in the chat.)
detail.access.mcp.composeHint
Pricing
Charged by the number of records successfully returned. Failed runs are not charged. Billed in units of 50 records; any partial unit is rounded up to 50 records.
Multiple billing events accumulate independently. See each item for details. Failed runs are not charged.
View creditsTry it now
Fill in the parameters and run. Results come from a real call.