Step-by-step tutorials for you to get started with web scraping
Download OctoparseWhat are concurrent runs?
Thursday, June 9, 2022The latest version for this tutorial is available here. Go to have a check now!
Tasks that are running concurrently means they are being executed simultaneously either in the cloud or on your local machine.
1. Local concurrent runs basically mean executing more than one task on the local machine. For this specific feature, the Free Plan is limited to two concurrent local runs while all the other plans allow for unlimited concurrent runs.
2. Cloud concurrent runs can be checked from the dashboard by filtering for “Running in the Cloud”.
3. Question: When a plan comes with 6 cloud servers, does it mean there should always be 6 concurrent runs in the cloud?
Answers: Not exactly. It is possible to have 6 concurrent runs when each executing task only takes up one cloud server to run. However, when a task is set to run in the cloud, Octoparse will first check to see if the task can be further split into smaller sub-tasks then assign each of the sub-task to run on a cloud server for speeding up the extraction. In this case, one task can take up more than one if not all of the cloud servers (Learn more about task splitting).
Tips!
![]()
|
Related Articles:
Select items in a drop-down menu
Extract multiple pages through pagination
Si quieres referirte a este tutorial de español, haz clic:¿Qué son las carreras concurrentes?
Download Octoparse to start web scraping or contact us for any
question about web scraping!