All Collections
Case Tutorial
Social Media
Scrape trending video information from YouTube
Scrape trending video information from YouTube
Updated over a week ago

You are browsing a tutorial guide for the latest Octoparse version. If you are running an older version of Octoparse, we strongly recommend you upgrade because it is faster, easier and more robust! Download and upgrade here if you haven't already done so!

The world's second most popular search engine is YouTube, directly behind Google. A large number of videos are available on YouTube – and their associated data and comments can be really valuable.

Octoparse can scrape YouTube easily with pre-built templates. You may want to check it out here: Task Templates. Just enter a keyword/URL to get data extracted in minutes!

In this tutorial, we are going to show you how to scrape trending video information from Youtube in only 3 steps with the Octoparse auto-detection feature.

Here is the YouTube trending video link we will use as an example.
https://www.youtube.com/feed/trending?gl=US

The main steps are shown in the menu on the right, and you can download the sample task file here


1. "Go To Web Page" - to open the target website

  • Create your task by inputting the URL in the search box on the homepage

  • Click the Start button nearby to move on


2. Auto-detect web page data - to create a workflow

  • Click Auto-detect web page data and wait for it to complete

After auto-detection, we may need to click Switch auto-detect results to ensure all the videos are selected.

  • Go to Data Preview to delete unwanted fields

  • Click Edit under the Add a page scroll to set up to scroll to the bottom of the page

  • Set Repeats as 20 times (you can set up more repeats to get more videos)

  • Confirm the settings

  • Click Create workflow


3. Run your task - to get data you want

  • Click Save, and click Run on the upper right side

  • Select Run on your device to run the task on your computer, or select Run in the Cloud to run the task in the Cloud (for premium users only)

Here is the sample data.

mceclip3.png
Did this answer your question?