Google News Scraper

📌 What data can you collect from Google News search results?

This template collects search-result records with Title, NewsURL, PublishDate, Keyword, Source, and NewsText. It is useful for researchers, analysts, journalists, librarians, and knowledge-management teams.

Data is collected from Google News. Google News organizes news coverage from publishers and makes articles discoverable by topic and query.

💰 Pricing

This template is currently free of charge and has no per-line usage fee. Octoparse plan or resource limits may still apply.

📦 Output

Google News Scraper returns these fields:

• Keyword
• Source
• Title
• PublishDate
• NewsURL
• NewsText
• error

{
  "Keyword": "Nobel Prize",
  "Source": "The Wall Street Journal",
  "Title": "The Most Fatuous Nobel Peace Prize - WSJ",
  "PublishDate": "2023-10-29T15:54:00Z",
  "NewsURL": "https://www.wsj.com/articles/nobel-peace-prize-obama-eu-7795cf7a",
  "NewsText": "The Most Fatuous Nobel Peace Prize Listen (41 sec) The Most Fatuous Nobel Peace Prize Listen (41 sec) https://www.wsj.com/articles/nobel-peace-prize-obama-eu-7795cf7a Oct. 29, 2023 10:54 am ET Listen (41 sec) In reviewing “Eurowhiteness” by Hans Kudnani (Bookshelf, Oct. 26), Tunku Varadarajan suggests, “Perhaps the most fatuous recent bestowal of the Nobel Peace Prize was its award in 2012 to the European Union for the ‘advancement of peace and reconciliation’ on the continent.” Even more fatuous was President Barack Obama’s 2009 Nobel Peace Prize merely for not being President George W. Bush. Shawn Clark Copyright ©2023 Dow Jones & Company, Inc. All Rights Reserved. 87990cbe856818d5eddac44c7b1cdeb8 Continue reading your article witha WSJ subscription Already a subscriber? Sign In WSJ Membership Customer Service Tools & Features Ads More Dow Jones Products WSJ Membership Customer Service Tools & Features Ads More Copyright ©2023 Dow Jones & Company, Inc. All Rights Reserved",
  "error": null
}

🎯 Use Cases

• Build a structured research dataset organized by Keyword and Title.
• Analyze source content and timing through NewsText and PublishDate.
• Use NewsURL to audit source records or feed verified pages into downstream workflows.
• Review and export PublishDate for operational analysis or reporting.

🐙 Why Octoparse

• Built for Google News: The automation applies Keywords(1~10) and Page scroll count, processes the resulting search pages and their result items, and writes structured rows including Keyword, Source, Title, and PublishDate.
• Inputs match the workflow: The form uses Keywords(1~10) (up to 10 entries), Page scroll count (1 to 50), and Keywords.
• Fields stay connected: Google News Scraper returns Title, NewsURL, PublishDate, NewsText, and Keyword in the same structured dataset.
• Ready for repeat use: After Google News Scraper runs locally or in the cloud, schedule eligible tasks and export the rows for spreadsheets, dashboards, APIs, or AI workflows.

📝 Input

Complete the following fields:

• Keywords (Required) — Enter a list of keywords to search for news on Google News. Up to 10 entries per run.
• Page scroll count (Required) — Enter a number to control the page scroll count. The higher the page scroll count, the more data will be collected. Maximum input is 50. Accepted range: 1 to 50.

🚀 How to Use

1. Open Google News Scraper and click Try it!.
2. Complete Keywords(1~10), Page scroll count, and Keywords using the formats and limits shown in the Input section.
3. Choose a local or cloud run in Octoparse and start the task.
4. Review fields such as Title, NewsURL, and PublishDate, then export the rows in the format you need.

💡 Tips

• Start with a focused Keywords(1~10) so the first run is easy to review before widening the search.
• Keep Keyword in the export so every row can be traced to its originating input or page.

❓ FAQ

How many entries can Google News Scraper accept in Keywords(1~10) per run?

Enter up to 10 values in Keywords(1~10) per run.

Which Google News pages does Google News Scraper process?

The workflow is configured for search-result pages and returns fields such as Title, NewsURL, PublishDate, and NewsText.

What can I use data from Google News Scraper for?

Build a structured research dataset organized by Keyword and Title.

🔗 Related Templates

• Google News Scraper (Cloud) — Use Google News Scraper (Cloud) for a complementary workflow on the same source site.
• Google Search Scraper — Use Google Search Scraper for an additional structured data workflow.