Pagination Scraping: Configure “Loop click next page” When It Can’t Be Detected

Monday, May 30, 2016 8:16 AM

Welcome to Octoparse’s tutorial. In this video, I’m going to show you how to configure pagination scraping rule when the “Next” page link can’t be detected in Octoparse.

Usually you find “Loop click next page” when you configure pagination by clicking on “Next page”.

But sometimes you can’t find the “Loop click next page” option as usual.


In this case, you need to configure pagination scraping rule in another way.

To do this, drop an “Loop” item into Workflow designer.

Choose an "Loop Mode" under "Advanced Options". Select "Single Element" option.


Make sure you locate the right place of the pagination link.

Then click the X path, and paste it in the text box.

Click “Save”.


Next, drop a “Click element” action into the “Loop item”

Choose “Click Loop items” under "Advanced Option".


Now you’ve configured pagination crawling. Feel free to contact us at


Download Octoparse and try it now!

If you like this video, please thumb up and subscribe our channel.

Join us on Facebook, Spaces, Pinterest and share your ideas with us!




Leave us a message

Your name*

Your email*




Attach file
Attach file
Please enter details of your issue and we will get back to you ASAP.