📌 What public post data can you extract from X hashtag searches?
This template collects structured records from search-results pages, including Category, Keyword, Web_Page_URL, Tweet_Website, Author_Name, Author_Web_Page_URL, Tweet_Timestamp, Tweet_Content, Tweet_Image_URL, Tweet_Video_URL, Tweet_AD, Tweet_Number_of_Reviews and other published output fields. It is useful for social media analysts, brand teams, researchers, and content strategists.
Data is collected from X (formerly Twitter). X is a social network for publishing posts and following public conversations in real time.
💰 Pricing
Current price: $0.3/1,000 lines. Billing is based on the number of output lines produced by the task.
📦 Output
Twitter Scraper (by hashtag) returns these fields:
keycountfail_counthash_keymsg_typecontentCategoryKeywordWeb_Page_URLTweet_WebsiteAuthor_NameAuthor_Web_Page_URLTweet_TimestampTweet_ContentTweet_Image_URLTweet_Video_URLTweet_ADTweet_Number_of_ReviewsTweet_Number_of_RetweetsTweet_Number_of_LikesTweet_Number_of_Looks
{
"key": null,
"count": null,
"fail_count": null,
"hash_key": null,
"msg_type": null,
"content": null,
"Category": "TopPost",
"Keyword": "#fridayfeeling",
"Web_Page_URL": "https://twitter.com/search?q=#fridayfeeling&src=typed_query&f=top",
"Tweet_Website": "https://twitter.com/Printtapp/status/1768257041947062311",
"Author_Name": "printtapp",
"Author_Web_Page_URL": "https://twitter.com/Printtapp",
"Tweet_Timestamp": "2024-03-14",
"Tweet_Content": "POV: Walking past the office printing queue, knowing our freshly printed documents are waiting for us at home. #fridayfeeling",
"Tweet_Image_URL": null,
"Tweet_Video_URL": "https://twitter.com/Printtapp/status/1768257041947062311",
"Tweet_AD": "False",
"Tweet_Number_of_Reviews": null,
"Tweet_Number_of_Retweets": null,
"Tweet_Number_of_Likes": null,
"Tweet_Number_of_Looks": null
}
🎯 Use Cases
- Use Keyword, Category, and Tweet_Content to compare conversations across hashtags.
- Use Tweet_Number_of_Retweets, Tweet_Number_of_Likes, and Tweet_Number_of_Looks to benchmark engagement.
- Use Author_Name and Author_Web_Page_URL to identify accounts contributing to a topic.
- Use Tweet_Timestamp, Tweet_Image_URL, and Tweet_Video_URL to study posting patterns and media formats.
🐙 Why Octoparse
- Built for X (formerly Twitter): Takes the configured Keywords/ Hashtags (up to 3), Scroll-down times (up to 200) inputs, submits each supplied value and iterates the returned records on X (formerly Twitter) search-results pages, then emits structured rows containing fields such as Category, Keyword, Web_Page_URL, Tweet_Website, Author_Name.
- Inputs match the workflow: The form uses Keywords/ Hashtags (up to 3 entries) and Scroll-down times (1 to 200).
- Fields stay connected: Twitter Scraper (by hashtag) returns
Author_Name,Web_Page_URL,Tweet_Number_of_Reviews,Tweet_Timestamp, andcontentin the same structured dataset. - Ready for repeat use: After Twitter Scraper (by hashtag) runs in the cloud, schedule eligible tasks and export the rows for spreadsheets, dashboards, APIs, or AI workflows.
📝 Input
Complete the following fields:
- Keywords/ Hashtags (Required) — Up to 3 entries per run.
- Scroll-down times (Optional) — Scroll-down times. Accepted range: 1 to 200.
🚀 How to Use
- Open Twitter Scraper (by hashtag) and click Try it!.
- Complete Keywords/ Hashtags and Scroll-down times using the formats and limits shown in the Input section.
- Run it in the Octoparse cloud and start the task.
- Review fields such as
Author_Name,Web_Page_URL, andTweet_Number_of_Reviews, then export the rows in the format you need.
💡 Tips
- Start with a focused Keywords/ Hashtags so the first run is easy to review before widening the search.
- Keep
Keywordin the export so every row can be traced to its originating input or page.
❓ FAQ
How many entries can Twitter Scraper (by hashtag) accept in Keywords/ Hashtags per run?
Enter up to 3 values in Keywords/ Hashtags per run.
Which X (formerly Twitter) pages does Twitter Scraper (by hashtag) process?
The workflow is configured for search-result pages and returns fields such as Author_Name, Web_Page_URL, Tweet_Number_of_Reviews, and Tweet_Timestamp.
What can I use data from Twitter Scraper (by hashtag) for?
Use Keyword, Category, and Tweet_Content to compare conversations across hashtags.
🔗 Related Templates
- Twitter (X) Comments Scraper — Use Twitter (X) Comments Scraper when review- or comment-level records are needed.
- Twitter Advanced Search Comments Scraper — Use Twitter Advanced Search Comments Scraper when review- or comment-level records are needed.
- Twitter Scraper (by Account URL) — Use Twitter Scraper (by Account URL) for a complementary workflow on the same source site.