Q: How to schedule a crawler/scraping task in Octoparse every hour?

 

 

A:

After you complete configuring your task, select the option “Schedule Cloud Extraction Settings” to begin the scheduling process.

 

 In the “Schedule Cloud Extraction Settings” dialog box, you can select

  • Periods of Availability - The data extraction period by setting the Start date and End date.
  • Run Mode - Running your periodic tasks to collect data with varying intervals: Once, Weekly, Monthly, Real Time

 

You can choose the fourth type - Real Time, and enter 60 in the textbox.

 

Please check out this tutorial to collect data with different intervals: 

Scheduled Data Extraction - Octoparse Cloud Web Scraping Service

 

 

Note:

 

When the periods of Availability you set does not within the task's effective period, you will get a pop-up saying, "Schedule Cloud Extraction Failed - Cloud extraction failed for task is out of effective date, please renew the effective date for task."

In this case, you can extend the task's effective period first.

In the "Schedule Cloud Extraction Settings" window, you can change the Start time and End time in the periods of Availability to extend the effective period of the task, then click Save to save the setting and the task's effective period will be changed.

Request Pro Trial Contact
us

Leave us a message

Your name*

Your email*

Subject*

Description*

Attachment(s)

Attach file
Attach file
Please enter details of your issue and we will get back to you ASAP.