What Cloud Extraction gives you
Run without your computerA cloud run continues without depending on your computer, local network connection, or an open Octoparse app.
Scrape data on a scheduleStart recurring runs at configured times so updated data can be scraped without a manual start each time.
Scale and accelerate eligible tasksOctoparse can run multiple tasks using account-level cloud capacity. It can also divide a splittable task into parallel subtasks across available nodes, reducing the time needed to process the workload compared with one sequential execution path.
Review runs in one placeCheck run progress, cloud data, subtask details, logs, and available error screenshots from the task’s cloud run views.
When to use Cloud Extraction
Use Cloud Extraction when:- A task needs to run after you leave the Octoparse app or turn off your computer.
- The same data needs to be scraped repeatedly.
- Several production tasks need to run using managed cloud resources.
- You need cloud run history and logs for unattended runs.
How to use Cloud Extraction
1
Build and test the task
Run representative samples locally and confirm that the fields, loops, pagination, login, and page loading behave as expected.
2
Start Cloud Extraction
Open the task editor or Task List and start the task in the cloud. You can also start selected tasks together or configure a cloud schedule.
3
Check the result
Open Cloud Run Details to review progress and extracted data. If a run does not behave as expected, inspect its subtask details, logs, and available screenshots before changing the task or starting it again.
Cloud Extraction runs the workflow as configured; it does not automatically correct an inaccurate selector, an expired login, or a website that behaves differently in the cloud environment. Validate the task before relying on unattended or recurring runs.
Which plans include Cloud Extraction
Cloud Extraction is available on paid plans. Each plan includes a different number of cloud nodes, which determine how much cloud execution capacity is available to the account.
Cloud nodes can be used to run different tasks concurrently or to process a splittable task in parallel. The number of nodes therefore does not always equal the number of complete tasks that can run at once. When all available nodes are in use, additional cloud work waits until capacity becomes available.
Learn more
Cloud resources and queuesUnderstand nodes, subtasks, concurrency, and queued runs.
Local vs cloud extractionChoose the right execution environment for a task.
Standard vs boost modeLearn how execution modes relate to task splitting and concurrency.
SchedulesConfigure recurring task runs.
Logs & event trackingDiagnose incomplete or stopped runs.