Step-by-step tutorials for you to get started with web scrapingDownload Octoparse
The latest version for this tutorial is available here. Go to have a check now!
In this tutorial, we are going to show you how to scrape images URLs from eBay.
To follow through, you might want to use the URL in this tutorial:
Here are the main steps in this tutorial:[Download task file here]
1)"Go To Web Page" - to open the targeted web page
2) Create a pagination loop - to scrape data from multiple listing pages
3) Create a "Loop Item" - to loop click into each product page on every listing page
We are now on the second page. When creating a "Loop Item", we should always start with the first item on the first page. Thus, we'd better go back to the first page.
By doing this, we can help Octoparse decide the execution order and generate the Loop Item at the appropriate position in the workflow.
Octoparse will automatically identify other product links on the current page. The selected links will be highlighted in green while others will be highlighted in red.
Octoparse will click through each link captured in the "Loop Item", and open the product detail page.
4)Extract data - to extract image URLs
When you select an IMG element, the selected tag would be "IMG".
The XPath that Octoparse generate automatically is not accurate, so we need to revise it.
Then we can repeat the above steps to get other images URLs.
If we need all of the images extracted in a cell, we can use RegExp Tool to pick up all the Image URLs from its HTML. Please check out the details from down below:
Pick up image URL with RegExp Tool.
5)Customize the data field – to get a normal size image (Optional)
The image URL we just extracted is the URL of a thumbnail image. Thus, if we want to get a normal size image, we need to reformat its URL with Octoparse Regular Expression Tool.
If you want to learn Octoparse RegExp Tool in detail，please refer to the following tutorials：
6) Save and start extraction - to get all the URLs of the desired images
With the above steps, we can only extract the Image URLs. If we need to download all the images from the extracted URLs, we could refer to How to download images from a list of URLs?
Here is the sample output:
Was this article helpful? Contact us anytime if you need our help!