Enterprise Data Consolidation and Integration

3 min read

Big data is no longer strange to people anymore, it can be integrated with any subject that you can imagine and has become indispensable in all fields. Data is becoming a core property and has greatly influenced how an enterprise runs its business and re-constructs its culture and structure. With that said it could be tough for a company to succeed without participating in the data revolution.

Data integration and consolidation can help enterprises exchange valuable information and make decisions much more efficiently. Enterprises can utilize data integration and consolidation to design their business system leading to a structural and hierarchical disparity on multiple levels, like company roles, product brands and etc. As we know, the traditional method enterprises normally adopt is to collect data manually, then utilize this data to make plans for the product development cycle, make marketing decisions and etc. Even though these enterprises have built up BI,  most data come from CRM, ERP, SCM, and other management systems that lack deep insight into data analysis and diversified data field dimensions. 

Knowing the importance of data, if the data relevant to people’s characteristic behaviors can flow freely among different enterprises, it would be beneficial to both ends. Enterprises will be able to utilize this data to better predict users’ preferences and consequently recommend the best-fitted packages based on related data analysis. However, there are still unresolved complications such as privacy, and whether such integration of data sources is agreed upon with their users.

Data from multi-sources should be associated in mapping, otherwise, the fragmented data can’t be used for deep learning or further analysis. So far, ID identifier is the only way to identify users. Traditional enterprises identify users using users’ IDs via CRM, hence they will need an ID mapping method if it involves big data consolidation among enterprises. The simplest way to deal with data consolidation on an enterprise level is to use an ID card or phone number since each enterprise will probably maintain this personal information. However, a compulsory restriction to limit the unique identifier is that people may refuse to publicize such private info from security reasons. In Europe, this info which belongs to the typical PII (Personally Identifiable Information) is officially forbidden. As users decline to the use of ID and other private info, the quality of data may be further sacrificed with phone numbers likely to change over time. Consequently, the telecom service provider, which generally requires authentic names and ID from their users, and tracks for phone number changes, is standing in a much more advantageous position. This data will all be very helpful for enterprises to resolve issues with separated ID’s.

Today, the Internet device ID is being used more than any other technique for enterprises consolidation. This type of ID can be captured via the Internet or from APP in local devices with its nature character spanning over time and space. However, it is not perfect still since it is hard to associate Internet device ID with users’ behaviors. Therefore, we still need a proper type of ID to associate all different kinds of data. Verizon once tried to offer a soft ID, like Cookie. Specifically, they insert an HTTP Header into the AD Exchange pointed by its users’ browsing behaviors, and Hash Code these User PII according to visiting time and location. Using this method, the AD Exchange User Data Usage flow can receive these IDs. As soon as users’ behaviors get authenticated within a specific time range, Verizon can reply to these inquisitions. These specific ID’s are coded according to specific times and service providers and could be applied to online or real-life situations.



Hot posts

Explore topics

Get web automation tips right into your inbox
Subscribe to get Octoparse monthly newsletters about web scraping solutions, product updates, etc.

Get started with Octoparse today


Related Articles