For the latest tutorials, visit our new self-service portal. Sharpen your skills and explore new ways to use Octoparse.

In this tutorial, we will show you how to scrape the posts from LinkedIn.com. To follow through, you may want to use this URL in the tutorial: https://www.linkedin.com/search/results/content/?keywords=google&origin=GLOBAL_SEARCH_HEADER&sid=DIi

Here are the main steps in this tutorial:  [Download task file here]

1. Go to Web Page - to open the target webpage

2. Login to the website - to access the data

3. Auto-detect webpage - to create workflow

4. Modify the XPath of Loop Item - to locate more posts

5. Run the task - to get the data

• Paste the URL and click Start

2. Login to the website - to access the data

• Click on Sign In button and choose Click URL to go to the log in page

• After the login page is loaded, click on the Email input box and choose Enter text 

• Input the LinkedIn Email address and confirm

• Click the password input box, choose Enter text, input the password and confirm
• Click Sign in button and choose Click button

• Set up the AJAX timeout to 10s

3. Auto-detect webpage - to create workflow

• Select Auto-detect web page data

• Wait for the detection to be completed - click Edit

• Click Create workflow

• Go to Data preview, double click on the header to rename it, or click ... to delete a field 

4. Modify the XPath of Loop Item - to locate more posts

LinkedIn pages are quite complicated. The auto-generated XPath does not work perfectly. So we need to update the XPath.

• Click on Loop Item and input the XPath 
• Click Apply to confirm

5. Run task - to get the data

Here is the sample output.

Happy Data Hunting!

Author: The Octoparse Team

For more information about Octoparse, please click here.

Sign up today.