Web Scraping Feature Study | Scraping from multi-pages: pagination with "Next" button

Wednesday, September 28, 2016 7:54 AM

What it is?

Pagination action is used when the content we want to scrape spans over different pages of a website. Octoparse mimics human browsing behaviors, so just as you would click to the next page as you browse through a website, Octoparse does the same when you use pagination feature.

Particularly, pagination with a "Next" button is a more common way for you to flip through pages.

 

When do you want to use it?

If you would be extracting data from more than one page, then use pagination to enable page flipping.

One common method for pagination with a “Next page” button is shown below, we can loop click next page to scrape.

 

           

How to use it?

 

Step 1. Click the "Next" button used for turning pages.

 

Step 2. When prompted, select "Loop click the element" to tell Octoparse to click each page in the Cycle Pages.

 

 

Step 3. Now, we could check if we have set up pagination successfully by click "Click to Paginate" action.                                 

 

 

Step 4. We can observe that the first page has flipped to the next one.

 

Done!

Now, let's look into how pagination works. Learn more about pagination related topics:

 

Author: The Octoparse Team

 

Download Octoparse Today

 For more information about Octoparse, please click hereSign up today!

 

 

30 Free Web Scraping Software

Collect Data from Amazon

Top 30 Free Web Scraping Software

- See more at: http://www.octoparse.com/tutorial/pagination-scrape-data-from-websites-with-query-strings-2/#sthash.gDCJJmOQ.dpuf
Request Pro Trial Data
Collection
Service
Email
us

Leave us a message

Your name*

Your email*

Subject*

Description*

Attachment(s)

Attach file
Attach file
Please enter details of your issue and we will get back to you ASAP.
× get my coupon now No Thanks