logo
EN

Twitter Advanced Search Scraper

Social MediaMCP

Collect tweets, likes, retweets, replies, and media automatically. Save hours of manual work and get ready-to-use data to Excel/CSV/JSON in seconds.

Templates are view-only on mobile. Please switch to a desktop to run this template.

Why Use This Twitter/X Search Scraper?

 🚀 Fast & Scalable

 Collect hundreds or thousands of tweets automatically without scrolling manually.

 📊 Rich Metadata Extraction

 Capture everything you need for deeper insights-engagement, media URLs, timestamps, and more.

 🔎 Targeted, Keyword-Based Scraping

 Type in keywords or hashtags (e.g., "Black Friday deals", "AI tools") and instantly fetch relevant, real-time or historical tweets.

 💼 Ideal for Teams & Organisations

 Researchers, marketers, analysts, and agencies rely on this template to extract structured Twitter/X data for reporting and analysis.

🔍 Explore Our Fastest Twitter/X Scraper Options

TemplateWhat to scrape
Twitter Advance Search ScraperTweets related data only
Twitter (X) Comments ScraperBoth tweets and comments data
Twitter Advanced Search Comments ScraperBoth tweets and comments data
Twitter Scraper (by Account URL)Tweets related data only
Twitter Scraper (by hashtag)Tweets related data only
Get Twitter CookiesCookies for Twitter Follower & Following Scraper to use
Twitter Follower & Following ScraperFollower and Following

Who Is This For?

📈 Marketers & Social Media Managers

Track hashtags, campaign performance, and emerging trends.

📚 Researchers & Analysts

Collect large datasets for sentiment analysis, topic modeling, or academic research.

🧠 Content Creators & Influencers

Identify trending conversations to optimize content ideas.

🏢 Agencies & Enterprises

Monitor brand mentions, competitors, public reactions, and industry discussions at scale.


🐙 Why Choose Octoparse?

  • Truly No-Code: Start collecting data in minutes - no scripts, no setup.
  • No Login Required: Scrape public tweets without Twitter/X authentication.
  • Automatic Anti-Blocking & Retries: Built-in logic for stable, continuous runs.
  • Cloud Runs: Run this template in the cloud without leaving your computer on.
  • Instant Exports to Excel/CSV: Download clean datasets for analysis or reporting.
  • Beginner-Friendly UI: Point, click, run - this template works right out of the box.
Start Scraping Twitter Data in Under 60 Seconds.
Join 100,000+ users extracting Twitter insights with Octoparse.

Input and Output

Input

{
  "dates": "Example: 2020-01-01",
  "dates_2": "Example: 2024-10-15",
  "max_Tweets_to_Extract": "Example: 100. (Enter how many tweets you want to scrape.)",
  "all_of_these_words": "Example: what's happening · contains both \"what's\" and \"happening\"",
  "this_exact_phrase": "Example: happy hour · contains the exact phrase \"happy hour\"",
  "any_of_these_words": "Example: cats dogs · contains either \"cats\" or \"dogs\" (or both)",
  "none_of_these_words": "Example: cats dogs · does not contain \"cats\" and does not contain \"dogs\"",
  "these_hashtags": "Example: #ThrowbackThursday · contains the hashtag #ThrowbackThursday",
  "from_these_accounts": "Example: @X · sent from @X",
  "to_these_accounts": "Example: @X · sent in reply to @X",
  "mentioning_these_accounts": "Example: @SFBART @Caltrain · mentions @SFBART or mentions @Caltrain",
  "minimum_replies": "Example: 280 · posts with at least 280 replies",
  "minimum_likes": "Example: 280 · posts with at least 280 Likes",
  "minimum_reposts": "Example: 280 · posts with at least 280 reposts",
  "language": "option-value",
  "include_\"Top\"_Results": "Switch Off to scrape only the Latest tab. Switch On to scrape both Top and Latest results.",
  "cloud_Cluster": "example",
  "scraping_mode": [
    "day"
  ],
  "reply_Filter": "true",
  "include_replies_and_original_posts": "true",
  "only_show_replies": "true"
}

Output

[
  {
    "Ads": "False",
    "Author_Handle": "Steh_Papaiano",
    "Author_Name": "Steh Papaiano",
    "Author_Web_Page_URL": "https://x.com/Steh_Papaiano",
    "Bookmark_Count": "14",
    "Language": "pt",
    "Like_Count": "362",
    "Post_ID": "2121030039143641580",
    "Post_URL": "https://x.com/search?q=iphone%20until%3A2026-11-13_00%3A00%3A00_UTC%20since%3A2026-11-11_00%3A00%3A00_UTC%20-filter%3Areplies&src=typed_query&f=live",
    "Query_Str": "iphone",
    "QuoteContent": "",
    "QuoteTwitterURL": "",
    "Reply_Count": "8",
    "Reply_to_Whom": "",
    "Reply_to_Whom_Handle": "",
    "Reply_to_Whom_URL": "",
    "Reply_to_Whom_Username": "",
    "Replying_to": "False",
    "Repost_Count": "100",
    "Tweet_Content": "Enquanto o brasileiro trabalha pra pagar boleto, Davi Alcolumbre usa o microfone do Senado pra falar do anelzinho antiestresse e justificar iPhone para senador. O contribuinte paga a conta, o marajá reclama da pressão e ainda ganha uma rosca pra relaxar. BRASÍLIA É UM CIRCO, o problema é que os palhaços somos nós.",
    "Tweet_Image_URL": "https://pbs.twimg.com/amplify_video_thumb/2121029556484108288/img/dwjP1xF6UBbRDSUM.jpg",
    "Tweet_URL": "https://x.com/Steh_Papaiano/status/2121030039143641580",
    "Type": "Latest",
    "UTC_Time": "2026-11-12 23:59:02+00:00",
    "Verified_Status": "True",
    "View_Count": "4041"
  }
]

⚠️ Important Notes Before You Start


❓ FAQs

1. Can I scrape private or protected tweets?

No, only public tweets are accessible.

2. Can I schedule automatic Twitter scraping?

Yes! Use cloud-based scheduled runs to scrape Twitter data automatically at set intervals (hourly, daily, weekly).

3. How many tweets can be scraped at one time?

You can extract unlimited tweets based on your search parameters. However, Twitter/X rate limits may apply. For best results, we recommend batching large datasets.

4. How fast can I scrape Twitter data?

Our scraper can extract hundreds of tweets in minutes, depending on your search criteria and date range.

5. Do I need a Twitter API key to use this scraper?

No! Unlike Twitter's official API, Octoparse scrapes public data without requiring API keys, developer accounts, or authentication.


🛠 How to Use: Step‑by‑Step Guide

1. Start the template

Click "Try it!" to load the template.

2. Fill in your parameters

On the input screen, enter the criteria you want to use - just like on Twitter/X's Advanced Search page:

⚠️ Note: Avoid entering keywords and hashtags at the same time - doing both together may disable the date‑range filter and lead to duplicate or unexpected results.

✍🏻 Input Fields Explained

ParameterRequired?Example
Dates (From)RequiredExample: 2020-01-01
Dates (To)RequiredExample: 2024-10-15
All of these wordsOptionalExample: what’s happening · contains both "what's" and "happening"
This exact phraseOptionalExample: happy hour · contains the exact phrase “happy hour”
Any of these wordsOptionalExample: cats dogs · contains either “cats” or “dogs” (or both)
None of these wordsOptionalExample: cats dogs · does not contain “cats” and does not contain "dogs"
These hashtagsOptionalExample: #ThrowbackThursday · contains the hashtag #ThrowbackThursday
From these accountsOptionalExample: @X · sent from @X
To these accountsOptionalExample: @X · sent in reply to @X
Mentioning these accountsOptionalExample: @SFBART @Caltrain · mentions @SFBART or mentions @Caltrain
Minimum repliesOptionalExample: 280 · posts with at least 280 replies
Minimum likesOptionalExample: 280 · posts with at least 280 Likes
Minimum repostsOptionalExample: 280 · posts with at least 280 reposts
LanguageOptionalExample: Any language, en, jp, fr, de
Max Tweets to ExtractRequiredExample: 100. (Enter how many tweets you want to scrape.)
Include "Latest" ResultsOptionalSwitch Off to scrapes only the Top tab. Switch On to Scrapes both Top and Latest results.

3. Run the scraper

  • Click "Start" to begin a Cloud run. (Greyed-out modes are not supported for this template.)
  • Octoparse will simulate browsing Twitter/X, applying your search query, scrolling through results, and extracting matching tweets.

4. Monitor & handle interruptions

  • If a sub‑task shows status "Stopped" (e.g. due to network glitch), re‑run that sub‑task to continue scraping.
  • Depending on how many tweets and how far back the date range goes, scraping may take time.

5. Export your data

  • Once scraping completes, go to the Output section to review.
  • Export the results - e.g. as CSV or Excel - for further analysis, filtering, or storage.

💡Tips

  • Use fewer keywords per run for higher accuracy.
  • For large datasets, break keywords or dates into multiple runs.