Twitter (X) Comments Scraper

📌 What post and reply data can you collect from public X post URLs?

This template collects the original public X post and its replies from direct status URLs, including post content, author details, timestamps, media, engagement metrics, reply content, and other published output fields. It is useful for social media analysts, brand teams, researchers, and content strategists.

Data is collected from X (formerly Twitter). X is a social network for publishing posts and following public conversations in real time.

💰 Pricing

Current price: $0.3/1,000 lines. Billing is based on the number of output lines produced by the task.

📦 Output

Twitter (X) Comments Scraper returns these fields:

• msg_type
• content
• key
• count
• fail_count
• hash_key
• Tweet_Website
• Tweet_ID
• Author_Name
• Author_Web_Page_URL
• Tweet_Posted_Time_UTC
• Tweet_Content
• Tweet_Image_URL
• Tweet_Likes
• Tweet_Retweets
• Tweet_Replies
• Tweet_Bookmarked
• Comment_Website
• Comment_Author_name
• Comment_Author_URL
• Comment_Timestamp
• Comment_Content
• Comment_Image_URL
• Comment_Likes
• Comment_Retweets
• Comment_Replies
• Is_Deleted
• Error_MSG
• Comment_View

{
  "msg_type": null,
  "content": null,
  "key": null,
  "count": null,
  "fail_count": null,
  "hash_key": null,
  "Tweet_Website": "https://twitter.com/jiwoongiez/status/1775106156165300336",
  "Tweet_ID": null,
  "Author_Name": "NORI ᥫ᭡",
  "Author_Web_Page_URL": "https://twitter.com/jiwoongiez",
  "Tweet_Posted_Time_UTC": null,
  "Tweet_Content": "jiwoong struggling with the iPhone stand that the live got muted and he just ended up using his hand to stream",
  "Tweet_Image_URL": null,
  "Tweet_Likes": "270",
  "Tweet_Retweets": "71",
  "Tweet_Replies": "3",
  "Tweet_Bookmarked": null,
  "Comment_Website": "https://twitter.com/ArmanS96691/status/1775118704029610449",
  "Comment_Author_name": "ArmanS96691",
  "Comment_Author_URL": "https://twitter.com/ArmanS96691",
  "Comment_Timestamp": "Tue Apr 02 11:10:53 +0000 2024",
  "Comment_Content": "@jiwoongiez 😛",
  "Comment_Image_URL": null,
  "Comment_Likes": "0",
  "Comment_Retweets": "0",
  "Comment_Replies": "0",
  "Is_Deleted": null,
  "Error_MSG": null,
  "Comment_View": null
}

🎯 Use Cases

• Use Tweet_Content and Tweet_Image_URL to study post topics and creative formats.
• Use Tweet_Likes, Tweet_Retweets, Tweet_Replies, and Tweet_Bookmarked to compare engagement.
• Use Author_Name and Author_Web_Page_URL to analyze participating accounts.
• Use Comment_Content, Comment_Likes, Comment_Replies, and Comment_View to study reply sentiment and response activity.

🐙 Why Octoparse

• Built for X (formerly Twitter): Takes the configured Tweet URLs (up to 100,000), Number of replies (up to 100,000) inputs, opens each supplied URL and follows the configured page loops on X (formerly Twitter) search-results and comments pages, then emits structured rows containing fields such as Tweet_Website, Tweet_ID, Author_Name, Author_Web_Page_URL, Tweet_Posted_Time_UTC.
• Inputs match the workflow: The form uses Tweet URLs (up to 100,000 entries) and Number of replies (0 to 100000).
• Fields stay connected: Twitter (X) Comments Scraper returns Author_Name, Author_Web_Page_URL, Comment_Website, Tweet_Posted_Time_UTC, and content in the same structured dataset.
• Ready for repeat use: After Twitter (X) Comments Scraper runs in the cloud, schedule eligible tasks and export the rows for spreadsheets, dashboards, APIs, or AI workflows.

📝 Input

Complete the following fields:

• Tweet URLs (Required) — Up to 100,000 entries per run.
• Number of replies (Optional) — Accepted range: 0 to 100000.

🚀 How to Use

1. Open Twitter (X) Comments Scraper and click Try it!.
2. Complete Tweet URLs and Number of replies using the formats and limits shown in the Input section.
3. Run it in the Octoparse cloud and start the task.
4. Review fields such as Author_Name, Author_Web_Page_URL, and Comment_Website, then export the rows in the format you need.

💡 Tips

• Test one representative value in Tweet URLs before submitting a large batch to Twitter (X) Comments Scraper.
• Keep Author_Web_Page_URL in the export so every row can be traced to its originating input or page.

❓ FAQ

How many entries can Twitter (X) Comments Scraper accept in Tweet URLs per run?

Enter up to 100,000 values in Tweet URLs per run.

Which X (formerly Twitter) pages does Twitter (X) Comments Scraper process?

The workflow is configured for search-result pages and comment pages and returns fields such as Author_Name, Author_Web_Page_URL, Comment_Website, and Tweet_Posted_Time_UTC.

What can I use data from Twitter (X) Comments Scraper for?

Use Tweet_Content and Tweet_Image_URL to study post topics and creative formats.

🔗 Related Templates

• Twitter Scraper (by hashtag) — Use Twitter Scraper (by hashtag) for a complementary workflow on the same source site.
• Twitter Scraper (by Account URL) — Use Twitter Scraper (by Account URL) for a complementary workflow on the same source site.
• Twitter Advanced Search Scraper — Use Twitter Advanced Search Scraper for a complementary workflow on the same source site.