Extract Information from LinkedIn Public Data 2
Monday, June 27, 2016 6:35 AMFor the latest tutorials, visit our new self-service portal. Sharpen your skills and explore new ways to use Octoparse.
In this tutorial, we will show you how to scrape the posts from LinkedIn.com. To follow through, you may want to use this URL in the tutorial: https://www.linkedin.com/search/results/content/?keywords=google&origin=GLOBAL_SEARCH_HEADER&sid=DIi
Here are the main steps in this tutorial: [Download task file here]
1. Go to Web Page - to open the target webpage
2. Login to the website - to access the data
3. Auto-detect webpage - to create workflow
4. Modify the XPath of Loop Item - to locate more posts
5. Run the task - to get the data
1. Go to Web Page - to open the target webpage
- Paste the URL and click Start
2. Login to the website - to access the data
- Click on Sign In button and choose Click URL to go to the log in page
- After the login page is loaded, click on the Email input box and choose Enter text
- Input the LinkedIn Email address and confirm
- Click the password input box, choose Enter text, input the password and confirm
- Click Sign in button and choose Click button
- Set up the AJAX timeout to 10s
3. Auto-detect webpage - to create workflow
- Select Auto-detect web page data
- Wait for the detection to be completed - click Edit
- Click Create workflow
- Go to Data preview, double click on the header to rename it, or click ... to delete a field
4. Modify the XPath of Loop Item - to locate more posts
LinkedIn pages are quite complicated. The auto-generated XPath does not work perfectly. So we need to update the XPath.
- Click on Loop Item and input the XPath
- Click Apply to confirm
5. Run task - to get the data
- Run the task in the top right corner
- Select Run task on your device to run the task on your local device.
Here is the sample output.
Happy Data Hunting!
Author: The Octoparse Team
For more information about Octoparse, please click here.
Sign up today.
If this video tutorial is not available for you, you can click hereto see the corresponding graphic tutorial.