logo
languageENdown
menu
Template GalleryTemplate Details

Twitter (X) Comments Scraper

Social MediaMCPMCP
Scrape tweet content, author, tweet post time, reply content, reply sender, reply time, etc from Twitter by search result URL.
All
Access Level
Run Mode
$0.3/1000 lines
Cost of Usage
2026/08/19
Last updated
Try it!

📌 What post and reply data can you collect from public X post URLs?

This template collects the original public X post and its replies from direct status URLs, including post content, author details, timestamps, media, engagement metrics, reply content, and other published output fields. It is useful for social media analysts, brand teams, researchers, and content strategists.

Data is collected from X (formerly Twitter). X is a social network for publishing posts and following public conversations in real time.

💰 Pricing

Current price: $0.3/1,000 lines. Billing is based on the number of output lines produced by the task.

📦 Output

The current published implementation can return the following fields:

  • msg_type
  • content
  • key
  • count
  • fail_count
  • hash_key
  • Tweet_Website
  • Tweet_ID
  • Author_Name
  • Author_Web_Page_URL
  • Tweet_Posted_Time_UTC
  • Tweet_Content
  • Tweet_Image_URL
  • Tweet_Likes
  • Tweet_Retweets
  • Tweet_Replies
  • Tweet_Bookmarked
  • Comment_Website
  • Comment_Author_name
  • Comment_Author_URL
  • Comment_Timestamp
  • Comment_Content
  • Comment_Image_URL
  • Comment_Likes
  • Comment_Retweets
  • Comment_Replies
  • Is_Deleted
  • Error_MSG
  • Comment_View
{
  "msg_type": null,
  "content": null,
  "key": null,
  "count": null,
  "fail_count": null,
  "hash_key": null,
  "Tweet_Website": "https://twitter.com/jiwoongiez/status/1775106156165300336",
  "Tweet_ID": null,
  "Author_Name": "NORI ᥫ᭡",
  "Author_Web_Page_URL": "https://twitter.com/jiwoongiez",
  "Tweet_Posted_Time_UTC": null,
  "Tweet_Content": "jiwoong struggling with the iPhone stand that the live got muted and he just ended up using his hand to stream",
  "Tweet_Image_URL": null,
  "Tweet_Likes": "270",
  "Tweet_Retweets": "71",
  "Tweet_Replies": "3",
  "Tweet_Bookmarked": null,
  "Comment_Website": "https://twitter.com/ArmanS96691/status/1775118704029610449",
  "Comment_Author_name": "ArmanS96691",
  "Comment_Author_URL": "https://twitter.com/ArmanS96691",
  "Comment_Timestamp": "Tue Apr 02 11:10:53 +0000 2024",
  "Comment_Content": "@jiwoongiez 😛",
  "Comment_Image_URL": null,
  "Comment_Likes": "0",
  "Comment_Retweets": "0",
  "Comment_Replies": "0",
  "Is_Deleted": null,
  "Error_MSG": null,
  "Comment_View": null
}

🎯 Use Cases

  • Use Tweet_Content and Tweet_Image_URL to study post topics and creative formats.
  • Use Tweet_Likes, Tweet_Retweets, Tweet_Replies, and Tweet_Bookmarked to compare engagement.
  • Use Author_Name and Author_Web_Page_URL to analyze participating accounts.
  • Use Comment_Content, Comment_Likes, Comment_Replies, and Comment_View to study reply sentiment and response activity.

🐙 Why Octoparse

  • Ready-to-use workflow: The extraction steps for X (formerly Twitter) are already configured, so you do not need to build the scraper from scratch.
  • Flexible execution: Run the ready-made task in the cloud without keeping a local computer online for the collection.
  • Structured, repeatable output: Results are returned as consistent rows that are easier to compare, filter, deduplicate, and process than manually copied pages.
  • Verified input guardrails: The form exposes the current inputs, selectable values, and meaningful limits configured for this template.
  • Practical data handoff: Review results in Octoparse and export or process them using the options supported by your Octoparse environment.

📝 Input

Complete the following fields:

  • Tweet URLs (Required) — Up to 100,000 entries per run.
  • Number of replies (Optional) — Accepted range: 0 to 100000.

🚀 How to Use

  1. Open the template and select Try it or Start.
  2. Complete the input fields listed above.
  3. Start the task using the supported cloud run mode.
  4. Review the output rows and export or process the structured data.

⚠️ Limitations

Results depend on what the source site exposes at run time. A listed output field can be empty when the source page does not provide that value. Input limits shown above are enforced by the template.

💡 Tips

Use specific, valid inputs and review a representative result before starting a large batch. Remove duplicate inputs when repeated records are not needed.

❓ FAQ

How does Octoparse collect data from X (formerly Twitter)?

The template takes direct X post URLs and the configured reply limit, extracts the status ID from each URL, retrieves the original post, paginates its replies when requested, and emits structured post and reply rows.

What input does this Twitter (X) Comments Scraper require?

Use the fields and accepted values shown in the Input section. Only user-relevant limits and selectable options are listed.

What data can I extract from X (formerly Twitter)?

The current output fields and a representative JSON Data Preview are listed in the Output section. Field availability can vary when the source page does not display a value.

How much does this Twitter (X) Comments Scraper cost?

The current price is $0.3/1,000 lines, and billing is based on the number of output lines produced by the task.

Why can some X (formerly Twitter) fields be empty?

Source pages do not always expose every value for every record, and layouts can vary by item, market, or current site response. The template returns a field when the current page provides it.

Can I export the collected X (formerly Twitter) data?

You can review the structured rows in Octoparse and export or process them using the options supported by your Octoparse environment.

🔗 Related Templates

Share