logo
languageENdown
menu
Template GalleryTemplate Details

Google News Scraper

Social MediaMCPMCP
Extract news title, publish date, and body text from Google News by keyword.
All
Access Level
Run Mode
Free
Cost of Usage
2026/08/19
Last updated
Try it!

📌 What data can you collect from Google News search results?

This template collects search-result records with Title, NewsURL, PublishDate, Keyword, Source, and NewsText. It is useful for researchers, analysts, journalists, librarians, and knowledge-management teams.

Data is collected from Google News. Google News organizes news coverage from publishers and makes articles discoverable by topic and query.

💰 Pricing

This template is currently free of charge and has no per-line usage fee. Octoparse plan or resource limits may still apply.

📦 Output

The current published implementation can return the following fields:

  • Keyword
  • Source
  • Title
  • PublishDate
  • NewsURL
  • NewsText
  • error
{
  "Keyword": "Nobel Prize",
  "Source": "The Wall Street Journal",
  "Title": "The Most Fatuous Nobel Peace Prize - WSJ",
  "PublishDate": "2023-10-29T15:54:00Z",
  "NewsURL": "https://www.wsj.com/articles/nobel-peace-prize-obama-eu-7795cf7a",
  "NewsText": "The Most Fatuous Nobel Peace Prize Listen (41 sec) The Most Fatuous Nobel Peace Prize Listen (41 sec) https://www.wsj.com/articles/nobel-peace-prize-obama-eu-7795cf7a Oct. 29, 2023 10:54 am ET Listen (41 sec) In reviewing “Eurowhiteness” by Hans Kudnani (Bookshelf, Oct. 26), Tunku Varadarajan suggests, “Perhaps the most fatuous recent bestowal of the Nobel Peace Prize was its award in 2012 to the European Union for the ‘advancement of peace and reconciliation’ on the continent.” Even more fatuous was President Barack Obama’s 2009 Nobel Peace Prize merely for not being President George W. Bush. Shawn Clark Copyright ©2023 Dow Jones & Company, Inc. All Rights Reserved. 87990cbe856818d5eddac44c7b1cdeb8 Continue reading your article witha WSJ subscription Already a subscriber? Sign In WSJ Membership Customer Service Tools & Features Ads More Dow Jones Products WSJ Membership Customer Service Tools & Features Ads More Copyright ©2023 Dow Jones & Company, Inc. All Rights Reserved",
  "error": null
}

🎯 Use Cases

  • Build a structured research dataset organized by Keyword and Title.
  • Analyze source content and timing through NewsText and PublishDate.
  • Use NewsURL to audit source records or feed verified pages into downstream workflows.
  • Review and export PublishDate for operational analysis or reporting.

🐙 Why Octoparse

  • Ready-to-use workflow: The extraction steps for Google News are already configured, so you do not need to build the scraper from scratch.
  • Flexible execution: Choose the supported local or cloud run mode to fit one-off checks or repeatable collection work.
  • Structured, repeatable output: Results are returned as consistent rows that are easier to compare, filter, deduplicate, and process than manually copied pages.
  • Verified input guardrails: The form exposes the current inputs, selectable values, and meaningful limits configured for this template.
  • Practical data handoff: Review results in Octoparse and export or process them using the options supported by your Octoparse environment.

📝 Input

Complete the following fields:

  • Keywords (Required) — Enter a list of keywords to search for news on Google News. Up to 10 entries per run.
  • Page scroll count (Required) — Enter a number to control the page scroll count. The higher the page scroll count, the more data will be collected. Maximum input is 50. Accepted range: 1 to 50.

🚀 How to Use

  1. Open the template and select Try it or Start.
  2. Complete the input fields listed above.
  3. Start the task using the supported local or cloud run mode.
  4. Review the output rows and export or process the structured data.

⚠️ Limitations

Results depend on what the source site exposes at run time. A listed output field can be empty when the source page does not provide that value. Input limits shown above are enforced by the template.

💡 Tips

Use specific, valid inputs and review a representative result before starting a large batch. Remove duplicate inputs when repeated records are not needed.

❓ FAQ

How does this scraper work?

The automation applies Keywords(1~10) and Page scroll count, processes the resulting search pages and their result items, and writes structured rows including Keyword, Source, Title, and PublishDate.

What do I need to enter?

Use the fields and accepted values shown in the Input section. Only user-relevant limits and selectable options are listed.

What data does this template return?

The current output fields and a representative JSON Data Preview are listed in the Output section. Field availability can vary when the source page does not display a value.

Is this template free to use?

It is currently free of charge and has no per-line usage fee. Octoparse plan or resource limits may still apply.

Why can some output fields be empty?

Source pages do not always expose every value for every record, and layouts can vary by item, market, or current site response. The template returns a field when the current page provides it.

Can I export the collected data?

You can review the structured rows in Octoparse and export or process them using the options supported by your Octoparse environment.

🔗 Related Templates

Share