Skip to main content
Schedules let Octoparse run tasks automatically at defined times or intervals. They are useful for recurring data collection workflows such as price monitoring, lead list updates, inventory checks, or routine reporting. Octoparse supports scheduled runs in both cloud and local. Cloud scheduling is recommended for most workflows because it runs without depending on your local computer. Local scheduling is available for cases where cloud extraction does not work or where the target website requires a local IP address for login or access.

​
When to use schedules

Use schedules when:
  • The same data needs to be collected repeatedly
  • You need daily, weekly, or hourly updates
  • The task should run outside working hours
  • Data needs to be ready before a report or downstream workflow
  • You want to reduce manual task starts

​
Scheduling workflow

1

Build and test the task

Confirm the task extracts the correct fields and handles pagination or detail pages correctly.
2

Choose the run environment

Use cloud extraction or local extraction for unattended scheduled runs.
3

Set the schedule

Choose when and how often the task should run.
4

Configure export

Set up manual or automatic export depending on where the data should go.
5

Monitor results

Check run history, logs, and exported records after scheduled runs.

​
What to check before scheduling

Before enabling a schedule, check:
  • Test the task manually before scheduling it.
  • Start with a conservative frequency.
  • Monitor the first few scheduled runs.
  • Use logs to diagnose failures.
  • Review exported records for missing fields or duplicates.
  • Adjust frequency if the website updates less often than expected.
Avoid scheduling tasks more frequently than needed. Excessive runs can create duplicate data, increase usage, and raise the chance of website blocking.