Ansel Barrett
Ansel works as a contributing author at Octoparse, where he leverages his interest in coding, machine learning, and other AI technologies to provide valuable insights into web scraping.
213 posts
Cragslist CAPTCHA Bypass
Captcha makes scraping from Craigslist truly challenging. You would need proxies for this or just pick a web scraping tool that can handle it.
2021-01-22T00:00:00+00:00 · 5 min read
Data Extraction 101: How to Extracting Structured Data from Web Pages
Structured data refers to the data that is organized, processed and accessed in a high level of categorization, stored mainly in a relational database. You can use two-dimensional table structure to logically implement the data.
2021-01-21T00:00:00+00:00 · 2 min read
How to Maintain Data Quality While Web Scraping
Web scraping helps get data at large scale. However, it is important to maintain data quality, to get high-quality, accurate data. Here are tips on how to maintain data quality while web scraping.
2021-01-20T00:00:00+00:00 · 5 min read
5 Essential Data Mining Skills for Recruiters
I summarized the 5 essential skills for any recruiters to better utilize aggregated data from the web and successfully recruit the perfect candidate through analyzing the mined data. I will show you step by step how to get the data needed and analyze it.
2021-01-20T00:00:00+00:00 · 5 min read
Top 5 Web Scraping Tools Comparison
In this article, I will go into great depth comparing the top 5 most popular web scrapers in the market - Octoparse, parsehub, Mozenda, dexi.io, and import.io.
2021-01-20T00:00:00+00:00 · 4 min read
Web Scraping Challenges and Workarounds
Certain web scraping challenges should be aware of before scraping information across various platforms. Some are easy to resolve, but some are impossible to surpass. Having said that, it is necessary to get well prepared in advance in case of unforeseeable business loss.
2020-06-04T00:00:00+00:00 · 5 min read
10 Simple Excel Functions for Data Analysis
Excel is one of the must-have data analysis tools in the market. To this day it provides more than 450 functions, but actually knowing how to use a few of them would be sufficient in most cases. In this article, I compiled 10 easy but widely used functions to facilitate data analysis in Excel. Feel free to try them out!
2020-05-07T00:00:00+00:00 · 4 min read
Web scraping using python vs web scraping tool
Web scraping has become a widely used technique for gathering and extracting data from websites. People begin to develop or use a variety of different software to achieve their goal. Generally, they are divided into 2 factions: coding and tools. In this passage, we will present a demo of scraping Tweets using these two methods.
2019-09-23T00:00:00+00:00 · 5 min read
What is Alternative Data and How Can You Use It?
Alternative data is often perceived as big data or “exhaust data” since its large scale and complex metrics. These data sets are normally less accessible and structured than tradition data which can be easily handled by Excel. Alternative data is primarily adopted in hedge funds and other financial industries. Web scraping automates the process of data extraction that allows you to scrape the data as the way you want
2019-08-02T00:00:00+00:00 · 5 min read