All Collections
Glossary
What are concurrent runs?
What are concurrent runs?
Updated over a week ago

Tasks that are running concurrently mean they are being executed simultaneously either in the cloud or on your local machine. Yet, there are still minor differences to be noted.

  1. Local concurrent runs mean the number of tasks running on the local machine. The Free Plan & Basic Plan are limited to two concurrent local runs while all other plans allow for unlimited concurrent runs.

  2. Cloud concurrent runs mean the number of tasks running in the Cloud at the same time.

Tip: You can check the concurrent runs in your account by using Filters:

filterrunning.jpg

Question: When a plan comes with 6 cloud nodes (such as the Standard Plan), does it mean there should always be 6 concurrent running tasks in the cloud?

Answer: Not exactly. When an account is assigned with 6 cloud nodes, it is possible to have 6 tasks running concurrently in the Cloud. However, in efforts to achieve maximum extraction speed, Octoparse will always try to split up the task into smaller sub-tasks. Once split, each sub-task will be run on a separate cloud node for faster data extraction. In this case, one task can take up more than one cloud node (Learn more about task splitting). Of course, if a task split is not needed, you can always disable "task split" such that you'd always get 6 tasks running concurrently in the Cloud.

TIPS:

1. If task spit is not intended, you can disable it in the task settings.

2. To speed up Cloud extraction, you could have fewer tasks running in parallel, which will free up more cloud nodes.

cloudtaskconcurrency.jpg

3. You can also set up the priority for the running list.

setpriority.jpg

Did this answer your question?