Google News Scraper (by URL)

📌 What data can you collect from Google News search results?

This template collects search-result records with Title, Title URL, News URL, PublishDate, Author, Keyword, Source, and News Text. It is useful for researchers, analysts, journalists, librarians, and knowledge-management teams.

Data is collected from Google News. Google News organizes news coverage from publishers and makes articles discoverable by topic and query.

💰 Pricing

This template is currently free of charge and has no per-line usage fee. Octoparse plan or resource limits may still apply.

📦 Output

Google News Scraper (by URL) returns these fields:

• Keyword
• Source
• Title
• Title_URL
• PublishDate
• Author
• News_URL
• News_Text

{
  "Keyword": "Nobel Prize",
  "Source": "The Wall Street Journal",
  "Title": "The Most Fatuous Nobel Peace Prize - WSJ",
  "Title_URL": null,
  "PublishDate": "2023-10-29T15:54:00Z",
  "Author": null,
  "News_URL": null,
  "News_Text": null
}

🎯 Use Cases

• Build a structured research dataset organized by Keyword, Title, and Title URL.
• Analyze source content and timing through News Text, Author, and PublishDate.
• Use Title URL and News URL to audit source records or feed verified pages into downstream workflows.
• Review and export Title URL for operational analysis or reporting.

🐙 Why Octoparse

• Built for Google News: The automation applies Google News search URLs (up to 1,000), processes the resulting search pages and their result items, and writes structured rows including Keyword, Source, Title, and Title URL.
• Inputs match the workflow: The form uses Google News search URLs (up to 1,000 entries).
• Fields stay connected: Google News Scraper (by URL) returns Title, Title_URL, PublishDate, News_Text, and Keyword in the same structured dataset.
• Ready for repeat use: After Google News Scraper (by URL) runs locally or in the cloud, schedule eligible tasks and export the rows for spreadsheets, dashboards, APIs, or AI workflows.

📝 Input

Complete the following fields:

• Google News search URLs (Required) — Google News search URL. Up to 1,000 entries per run.

🚀 How to Use

1. Open Google News Scraper (by URL) and click Try it!.
2. Complete Google News search URLs using the formats and limits shown in the Input section.
3. Choose a local or cloud run in Octoparse and start the task.
4. Review fields such as Title, Title_URL, and PublishDate, then export the rows in the format you need.

💡 Tips

• Test one representative value in Google News search URLs before submitting a large batch to Google News Scraper (by URL).
• Keep Keyword in the export so every row can be traced to its originating input or page.

❓ FAQ

How many entries can Google News Scraper (by URL) accept in Google News search URLs per run?

Enter up to 1,000 values in Google News search URLs per run.

Which Google News pages does Google News Scraper (by URL) process?

The workflow is configured for search-result pages and returns fields such as Title, Title_URL, PublishDate, and News_Text.

What can I use data from Google News Scraper (by URL) for?

Build a structured research dataset organized by Keyword, Title, and Title URL.

🔗 Related Templates

• Google News Scraper (Cloud) — Use Google News Scraper (Cloud) for a complementary workflow on the same source site.
• Google News Scraper — Use Google News Scraper for a complementary workflow on the same source site.