Scrape an e-commerce website
E-commerce scraping falls into two page types. Listing pages carry the basics — title, price, and URL for many products at once. Detail pages hold richer information such as full specs, descriptions, images, and reviews. You can scrape detail pages on their own, or chain them after a listing page to collect both. Scrape a product listing page
Scrape a product details page
Step-by-step guides:
- Scrape a list of data
- Click each link in a list and scrape data from new pages
- Scrape data from both listing and detail pages
- Scrape product information from eBay
Move through pagination
Most sites split results across multiple pages. Octoparse handles the two most common patterns with a few settings. “Load more” button
Infinite scroll
Step-by-step guides:
- Dealing with pagination (Load more button)
- Scrape information that needs to be clicked to show
- Dealing with pagination (infinite scroll)
- Set up a page scroll
- Scroll within a designated area of a page
Scrape a table
Tables arrange data in rows and columns. This demo shows how to extract one with a custom task.
Step-by-step guides: