Q: How to improve the speed of data extraction?
A: Actually, the speed of data extraction is mainly determined by several factors.
- The speed of your computer's CPU(Central Processing Unit), especially when you are using Local Extraction.
- The amount of the data you plan to crawl
- Free trial or paid accounts ( Standard Edition/Professional Edition)
- Local Extraction or Cloud Extraction.
If the data that you want to extract is not too much, Octoparse can finish your job very quickly even though you’ re using local extraction.
But if the amount of the data you want is way huge and you would like to speed up the extraction task, Cloud Extraction is strongly recommended.
Besides using Cloud Extraction, you can also improve the speed of data extraction by choosing the right way to configure your rule.
When the website you plan to crawl is complicated and the amount of the data you want is very huge, choosing “List of URLs” for extraction is recommend.