Twitter Advanced Search Scraper

Collect data from Twitter Advanced Search Scraper.

Data collection Social Media X (Twitter)Posts

Overview

What this app does

Collect public data from Twitter Advanced Search Scraper.

Notes

Data is collected from Octoparse public crawling endpoints.
This app is rate-limited by upstream platform responses and pagination.

Scope and boundaries

Each run uses the template 'twitter-scraper-by-keywords' with validated input schema constraints.

Good for
Use this app when you need public data from the corresponding source template.

Do not use for
Do not use it for login-only, private, or inaccessible data that is not publicly visible.

Failure handling

Failure and retry behavior declared by the author. We recommend including it in your system prompt when integrating.

1Retry failed runs with smaller input scope. If repeated failures continue, verify input format and retry later.

Input

Parameters required to call this App, generated from the input.schema in manifest.json.

Field	Business name	Type	Required	Default	Enum / Constraints	Example	Description
dates	Dates (From)	string	Yes	—	—	2024-01-01	Dates (From)
dates_2	Dates (To)	string	Yes	—	—	2024-01-02	Dates (To)
max_Tweets_to_Extract	Max Tweets to Extract	number	Yes	—	—	10	Max Tweets to Extract
all_of_these_words	All of these words	string	No	—	—	technology	All of these words
this_exact_phrase	This exact phrase	string	No	—	—	This exact phrase	This exact phrase
any_of_these_words	Any of these words	string	No	—	—	Any of these words	Any of these words
none_of_these_words	None of these words	string	No	—	—	None of these words	None of these words
these_hashtags	These hashtags	string	No	—	—	These hashtags	These hashtags
from_these_accounts	From these accounts	string	No	—	—	From these accounts	From these accounts
to_these_accounts	To these accounts	string	No	—	—	To these accounts	To these accounts
mentioning_these_accounts	Mentioning these accounts	string	No	—	—	Mentioning these accounts	Mentioning these accounts
minimum_replies	Minimum replies	number	No	—	—	1	Minimum replies
minimum_likes	Minimum likes	number	No	—	—	1	Minimum likes
minimum_reposts	Minimum reposts	number	No	—	—	1	Minimum reposts
language	Language	string	No	—	—	Language	Language
include_Top_Results	Include "Top" Results	string	No	—	—	Include "Top" Results	Include "Top" Results
cloud_Cluster	Cloud Cluster	string	No	—	—	Cloud Cluster	Cloud Cluster
scraping_mode	Scraping mode	array<string>	Yes	—	—	["day"]	Scraping mode
reply_Filter	Reply Filter	string	No	—	—	Reply Filter	Reply Filter
include_replies_and_original_posts	Include replies and original posts	string	No	—	—	Include replies and original posts	Include replies and original posts
only_show_replies	Only show replies	string	No	—	—	Only show replies	Only show replies

Output

Field structure of a single record, generated from the output.schema in manifest.json.

Field	Business name	Type	Description
ads	Ads	string	—
author_Handle	Author_Handle	string	—
author_Name	Author_Name	string	—
author_Web_Page_URL	Author_Web_Page_URL	string	—
bookmark_Count	Bookmark_Count	string	—
language	Language	string	—
like_Count	Like_Count	string	—
post_ID	Post_ID	string	—
post_URL	Post_URL	string	—
query_Str	Query_Str	string	—
quoteContent	QuoteContent	string	—
quoteTwitterURL	QuoteTwitterURL	string	—
reply_Count	Reply_Count	string	—
reply_to_Whom	Reply_to_Whom	string	—
reply_to_Whom_Handle	Reply_to_Whom_Handle	string	—
reply_to_Whom_URL	Reply_to_Whom_URL	string	—
reply_to_Whom_Username	Reply_to_Whom_Username	string	—
replying_to	Replying_to	string	—
repost_Count	Repost_Count	string	—
tweet_Content	Tweet_Content	string	—
tweet_Image_URL	Tweet_Image_URL	string	—
tweet_URL	Tweet_URL	string	—
type	Type	string	—
uTC_Time	UTC_Time	string	—
verified_Status	Verified_Status	string	—
view_Count	View_Count	string	—

Record schema

Output is returned record by record. detail.output.idFieldHint

output.schema

{
  "type": "object",
  "properties": {
    "ads": {
      "type": "string",
      "title": "Ads",
      "prefill": ""
    },
    "author_Handle": {
      "type": "string",
      "title": "Author_Handle",
      "prefill": ""
    },
    "author_Name": {
      "type": "string",
      "title": "Author_Name",
      "prefill": ""
    },
    "author_Web_Page_URL": {
      "type": "string",
      "title": "Author_Web_Page_URL",
      "prefill": ""
    },
    "bookmark_Count": {
      "type": "string",
      "title": "Bookmark_Count",
      "prefill": ""
    },
    "language": {
      "type": "string",
      "title": "Language",
      "prefill": ""
    },
    "like_Count": {
      "type": "string",
      "title": "Like_Count",
      "prefill": ""
    },
    "post_ID": {
      "type": "string",
      "title": "Post_ID",
      "prefill": ""
    },
    "post_URL": {
      "type": "string",
      "title": "Post_URL",
      "prefill": ""
    },
    "query_Str": {
      "type": "string",
      "title": "Query_Str",
      "prefill": ""
    },
    "quoteContent": {
      "type": "string",
      "title": "QuoteContent",
      "prefill": ""
    },
    "quoteTwitterURL": {
      "type": "string",
      "title": "QuoteTwitterURL",
      "prefill": ""
    },
    "reply_Count": {
      "type": "string",
      "title": "Reply_Count",
      "prefill": ""
    },
    "reply_to_Whom": {
      "type": "string",
      "title": "Reply_to_Whom",
      "prefill": ""
    },
    "reply_to_Whom_Handle": {
      "type": "string",
      "title": "Reply_to_Whom_Handle",
      "prefill": ""
    },
    "reply_to_Whom_URL": {
      "type": "string",
      "title": "Reply_to_Whom_URL",
      "prefill": ""
    },
    "reply_to_Whom_Username": {
      "type": "string",
      "title": "Reply_to_Whom_Username",
      "prefill": ""
    },
    "replying_to": {
      "type": "string",
      "title": "Replying_to",
      "prefill": ""
    },
    "repost_Count": {
      "type": "string",
      "title": "Repost_Count",
      "prefill": ""
    },
    "tweet_Content": {
      "type": "string",
      "title": "Tweet_Content",
      "prefill": ""
    },
    "tweet_Image_URL": {
      "type": "string",
      "title": "Tweet_Image_URL",
      "prefill": ""
    },
    "tweet_URL": {
      "type": "string",
      "title": "Tweet_URL",
      "prefill": ""
    },
    "type": {
      "type": "string",
      "title": "Type",
      "prefill": ""
    },
    "uTC_Time": {
      "type": "string",
      "title": "UTC_Time",
      "prefill": ""
    },
    "verified_Status": {
      "type": "string",
      "title": "Verified_Status",
      "prefill": ""
    },
    "view_Count": {
      "type": "string",
      "title": "View_Count",
      "prefill": ""
    }
  },
  "required": [],
  "additionalProperties": false
}

Integration

This App can be integrated via MCP, API, SDK, or file export. All channels share the same capabilities and pricing. Every request authenticates with the Authorization: Bearer header using an API key (long-lived, created in the Data Hub Console); MCP clients can also sign in with OAuth, no key required. More options such as CLI and Skill are on the way.

With the MCP (Model Context Protocol), you can call this App directly from AI clients like Claude and Cursor. Pick your client and auth mode, then copy the config below.

Client config

Replace the value after Bearer with your long-lived API key. Works in any client, CI, or headless environment.

mcpServers config

{
  "mcpServers": {
    "YiJacobJohnRaku__twitter-scraper-by-keywords": {
      "type": "http",
      "url": "https://mcp-v2.octoparse.com?pin=YiJacobJohnRaku/twitter-scraper-by-keywords",
      "headers": { "Authorization": "Bearer <YOUR_API_KEY>" }
    }
  }
}

View my API Keys →

Let AI set it up for you

Don't want to edit configs by hand? Copy the install prompt and paste it into any AI client. It will complete the setup its own way. (The prompt asks the AI to request your API key from you, so credentials never end up in chat history or shared configs.)

detail.access.mcp.composeHint

Pricing

returned record

Charged by the number of records successfully returned. Failed runs are not charged.

$0.0003/ record

Multiple billing events accumulate independently. See each item for details. Failed runs are not charged.

View credits

Try it now

Fill in the parameters and run. Results come from a real call.

Example

Parameters are validated against input.schema before submission

Dates (From)dates*Dates (From)

Dates (To)dates_2*Dates (To)

Max Tweets to Extractmax_Tweets_to_Extract*Max Tweets to Extract

All of these wordsall_of_these_words (optional)All of these words

This exact phrasethis_exact_phrase (optional)This exact phrase

Any of these wordsany_of_these_words (optional)Any of these words

None of these wordsnone_of_these_words (optional)None of these words

These hashtagsthese_hashtags (optional)These hashtags

From these accountsfrom_these_accounts (optional)From these accounts

To these accountsto_these_accounts (optional)To these accounts

Mentioning these accountsmentioning_these_accounts (optional)Mentioning these accounts

Minimum repliesminimum_replies (optional)Minimum replies

Minimum likesminimum_likes (optional)Minimum likes

Minimum repostsminimum_reposts (optional)Minimum reposts

Languagelanguage (optional)Language

Include "Top" Resultsinclude_Top_Results (optional)Include "Top" Results

Cloud Clustercloud_Cluster (optional)Cloud Cluster

Scraping modescraping_mode*Scraping mode

Reply Filterreply_Filter (optional)Reply Filter

Include replies and original postsinclude_replies_and_original_posts (optional)Include replies and original posts

Only show repliesonly_show_replies (optional)Only show replies

Please fill in the required parameters first

$0.0003 / record