You are browsing a tutorial guide for the latest Octoparse version (8.5.4). If you are running an older version of Octoparse, we strongly recommend you upgrade because it is faster, easier and more robust! Download and upgrade here if you haven't already done so!
The latest version introduces the function of downloading files and pictures to local devices so that we can directly open the files and pictures from local folders. Document downloads in jpg, png, gif, doc, pdf, ppt, txt, xls, and zip formats are currently supported.
In this tutorial, we are going to show you how to download files and images with Octoparse. Please note that file downloads can only be used in local runs currently.
Sample URL for the downloaded file settings:
The sample URL for the downloaded image settings is: https://www.rappi.com.mx/tiendas/tipo/market
1. Download Files
Click on one of the files - Choose one document you want to download and the selected element will turn green, similar elements will turn red
Click on Select all similar elements from the Tips panel - All documents will be identified and selected to turn green
Click Document file - To extract the links as well as download the files to local folders
The data field will look like the one below, you can click the ... icon in the upper right corner to modify the data fields.
Note: Deleting the field with a folder icon in the name will cancel the download settings.
Name downloaded files: You can easily rename the downloaded files using the four provided options. These options can be found on the Tips panel after you click Document file.
MD5 Hash Value: Use the MD5 value to name the files
Original File Name: Default original file name
Download Complete Time: Use complete download time to name the files
Data Field Value: Use the data field value to name the files
If the file name already exists in the folder, there are also three ways to deal with the situation.
Skip the new file: Skip the current downloaded file
Replace the existing file: Replace the existing file with the newly downloaded file
Rename the new file: Rename the new file with a (1) at the end of the file name
2. Download Images
Downloading images to local folders shares the same logic as downloading files.
Click on one image - Choose one image
Click on Select All from the Tips box - Select all images
Click Image file - To extract the links as well as download the images to local folders
Note: Only complete URLs with "https://" can be downloaded directly with Octoparse. If the URL value scraped is only part of the complete download link, you can use the Add prefix or other data refining features in the Clean Data function to get the valid download links.
3. Download Settings
3.1 Download file settings
Click the arrow icon in front of the data field
You can rename the downloaded files, separate multiple URLs and input URLs to skip the download files here
3.2 Download Location settings
Click on the Task Settings icon in the upper right corner of the task settings screen - To open the settings panel
Click the Browse button - Choose a local folder for the downloaded files and images
Choose one mode for the When a local run starts settings
Click Save - Save all the modifications
