Data Mining Explained With 10 Interesting Stories

"Big Data", a term that grows more and more popular among the public, as well as "data mining", a practical example of "Big Data". Though everyone talks about "Big Data" or "Data Mining", do you really know what it is? Here we will briefly introduce some real life examples of how Big Data had impacted our lives via 10 interesting stories. 

 

 

1. A classic case: Diaper and Beer
Walmart’s market researcher found that when male customers visit the baby department to pick up diapers for their little ones, it's very likely for them to buy themselves a couple beers. Thus, Walmart relocated the beers next to diapers, which had led the sales of beers and diapers increased significantly.

2. Car manufacturer improved vehicle models via social media platform
Big Data brought impacts to Ford’s vehicles in the very beginning of car designing.
Ford’s R&D team once made analysis on the ways to open up the back truck of their SUV's (such as open manually or automatically). Though their routine surveys does not reflect this as a potential issue as no customer was reporting it, by analyzing the social platforms, Ford's team found that people actually talked over it a lot.

3. Use CCTVs to switch menus
A fast food restaurant was innovative enough to switch between different menus shown in the big screen based on how long the queue is detected through CCTV's. Based on a pre-set algorithm, CCTVs send queue info to computer which then carries out computation and sends back the results to control over which menu to display on the big screen. For example, if the line is long, then the menu screen will offer more fast food options and when the line is short, the menu screen will offer dishes that are more profitable but may take up more time to prepare.

4. Google successfully forecasted winter flu
In 2009, Google studied 50 million most frequent retrieved words and compare it with CDC’s data of 2003-2008 flu seasons to built a statistic model. Eventually this model successfully forecasted the spread of winter flu, even specific to states.

5. Big Data knows more about your music preference
The music you listen in car may in some extent reflect your music preference. Gracenote got the technics that use the built-in microphones on smartphones and tablets to recognize songs played on user's TV or stereo, detect reactions such as applause or boos, and even detect if the user has turned up the volume. In this way, Gracenote can study the songs that are liked by the users and the specific time and place when this song is played.

6. Microsoft Big Data successfully predicted 21 Oscar Rewards
In 2013, David Rothschild in Microsoft Institute New York used Big data to successfully predict 19 out of 24 Oscar rewards, and 21 Oscar rewards in the following year.

7. Use Big data to forecast crime scenes
PredPol, working with Los Angeles and Santa Cruz police and a team of researchers, predicts the odds of a crime occurring based on a variation of earthquake prediction algorithms and crime data that can be accurate to within 500 square feet. In Los Angeles, where the algorithm was applied, the distribution of theft and violent crime dropped by 33% and 21% correspondingly.

8. Octoparse used reviews to refine products
Octoparse, a Saas company dedicates in web scraping, always keep client’s suggestion in mind. In 2017, Octoparse collected thousands of reviews from clients, and used NLP to study the reviews, and upgraded the product, and client’s experience is greatly improved.

9. Find your date by Big data
Mathematician Chris McKinlay is a PhD student at UCLA. After failing to find the right girl after many blind dates, he thought he should use the dating site like a mathematician. With his talent, McKinlay has created a self-made robot program that uses fake OkCupid accounts to gather a wealth of information of women from the Web. McKinlay spent three weeks collecting 60,000 questions and answers from 20,000 women in the United States. He then classsify the women users into seven clusters with different systems based on the improved K-Modes algorithm he had developed. Through the use of a mathematical model to calculate the way to optimize the two groups of women, and then dating. While dating the 88th female netizen, he found his true love.

10. Alibaba implemented anti-counterfeit acts by Big Data
Alibaba recently disclosed a series of counterfeit cases. Ali Security Department claimed that "the most reliable big data, in fact, is the account transaction data, logistics and shipping information." Alibaba's security staff said they can track offline warehouses through inquiries on shipping addresses, IP addresses, return addresses and more. Account transaction data can be disclosed for each transaction and each sales record. Even if sellers use different IDs and stores, they can find offline fake merchants through big data. According to Alibaba's PR department, after years of practices, a big data crackdown model for monitoring, analyzing and cracking down on counterfeit goods systems has been established and is currently in used when cooperating with the police to boycott counterfeit goods.

There are so many practical uses of Big data and data mining in our lives. In a few words, something you felt magical, may count on Big data. Explore fun stories about Big data in your lives, and we are happy to speak it out for you.

 

More Related Articles:

Get Started with Octoparse in 2 minutes

Top 30 Big Data Tools for Data Analysis

Top 30 Free Web Scraping Software 

Big Data: 70 Amazing Free Data Sources You Should Know for 2017