Web Scraping Feature Study | Scraping from multi-pages: pagination with "Next" buttonWednesday, September 28, 2016 7:54 AM
What it is？
Pagination action is used when the content we want to scrape spans over different pages of a website. Octoparse mimics human browsing behaviors, so just as you would click to the next page as you browse through a website, Octoparse does the same when you use pagination feature.
Particularly, pagination with a "Next" button is a more common way for you to flip through pages.
When do you want to use it?
If you would be extracting data from more than one page, then use pagination to enable page flipping.
One common method for pagination with a “Next page” button is shown below, we can loop click next page to scrape.
How to use it?
Step 1. Click the "Next" button used for turning pages.
Step 2. When prompted, select "Loop click the element" to tell Octoparse to click each page in the Cycle Pages.
Step 3. Now, we could check if we have set up pagination successfully by click "Click to Paginate" action.
Step 4. We can observe that the first page has flipped to the next one.
Now, let's look into how pagination works. Learn more about pagination related topics:
- Pagination Loop issue: The extraction stops after 3 pages
- Create A Loop For Pagination Manually
- Pagination Scraping: Configure “Loop click next page” When It Can’t Be Detected
Author: The Octoparse Team