Reddit Subreddit Scraper

📌 How can you collect posts from selected subreddit feeds?

This template collects subreddit and post records including subreddit URL, post URL, linked article URL, post title, author, post time, upvotes, comment count, and selected feed tab. It is useful for community managers, social listening teams, and research analysts.

Data is collected from Old Reddit. Reddit is a community platform where subreddit feeds organize posts by tabs such as new, top, rising, and controversial.

💰 Pricing

Current price: $0.02/1,000 lines. Billing is based on the number of output lines produced by the task.

📦 Output

Reddit Subreddit Scraper returns these fields:

• Subreddit
• Subreddit_URL
• Post_URL
• Article_URL
• Post_title
• Author
• Post_time
• Upvote
• Comment_count
• Tab

{
  "Subreddit": "cats",
  "Subreddit_URL": "https://old.reddit.com/r/cats/",
  "Post_URL": "https://www.reddit.com/r/cats/comments/1bok11r/show_me_a_picture_of_your_cat_that_cracks_you_up/",
  "Article_URL": null,
  "Post_title": "Show me a picture of your cat that cracks you up every time you see it.",
  "Author": "EotEaH",
  "Post_time": "2024/03/26 09:41:54 PM",
  "Upvote": "12178",
  "Comment_count": "1865",
  "Tab": null
}

🎯 Use Cases

• Monitor subreddit topics using post titles and article URLs.
• Compare engagement using upvotes and comment counts.
• Track publishing activity using authors and post times.
• Compare content surfaced by different subreddit tabs.

🐙 Why Octoparse

• Built for Old Reddit: The Python automation opens each submitted subreddit URL in the selected feed tab, paginates until the configured item target is reached or content ends, parses post cards, and uploads one structured row per post.
• Inputs match the workflow: The form uses Tab, SubReddits or communities URLs (up to 100,000 entries), and Max_Items (1 to 999999999).
• Fields stay connected: Reddit Subreddit Scraper returns Post_title, Subreddit_URL, Comment_count, Post_time, and Subreddit in the same structured dataset.
• Ready for repeat use: After Reddit Subreddit Scraper runs in the cloud, schedule eligible tasks and export the rows for spreadsheets, dashboards, APIs, or AI workflows.

📝 Input

Complete the following fields:

• Tab (Required) — Select the Reddit listing tab to collect. Available options: Hot, New, Rising, Controversial, Top.
• SubReddits or communities URLs (Required) — Subreddit URL. Up to 100,000 entries per run.
• Max_Items (Optional) — Accepted range: 1 to 999999999.

🚀 How to Use

1. Open Reddit Subreddit Scraper and click Try it!.
2. Complete Tab, SubReddits or communities URLs, and Max_Items using the formats and limits shown in the Input section.
3. Run it in the Octoparse cloud and start the task.
4. Review fields such as Post_title, Subreddit_URL, and Comment_count, then export the rows in the format you need.

💡 Tips

• Start with a small, representative Tab selection before scaling the task.
• Use Post_title and Subreddit_URL when checking duplicates or comparing repeated exports.

❓ FAQ

What do I enter in Reddit Subreddit Scraper?

Complete Tab, SubReddits or communities URLs, and Max_Items using the accepted values and limits listed in the Input section.

Which Old Reddit pages does Reddit Subreddit Scraper process?

The workflow is configured for comment pages and returns fields such as Post_title, Subreddit_URL, Comment_count, and Post_time.

What can I use data from Reddit Subreddit Scraper for?

Monitor subreddit topics using post titles and article URLs.

🔗 Related Templates

• Reddit Search Scraper — Use Reddit Search Scraper for a complementary workflow on the same source site.
• Reddit Trending Scraper — Use Reddit Trending Scraper for a complementary workflow on the same source site.
• Reddit Post Scraper (by Keywords) — Use Reddit Post Scraper (by Keywords) for a complementary workflow on the same source site.