Teradata Baoliming: No invalid data in the Big Data age

Teradata Company CTO Baoliming (Stephen Brobst)

May 22 News, Big data manufacturer Teradata Company CTO Baoliming (Stephen Brobst) recently in the "2013 Teradata Big Data Summit" to Tencent technology, can not blindly deny seemingly useless data, they also contain value, It's just that you haven't found the value embodiment, you can save it with a Low-cost storage server.

Data is valuable

How do you differentiate the value of large data? Baoliming says there is no denying the use of useless data, and they also contain value, and they are supposed to be low value density data. Therefore, the enterprise should also retain this data, but has not found its value for the time being, you can use Low-cost storage server to retain them.

He said, for example, that when people search through the engine, there are some habitual spelling mistakes. These error data, while seemingly meaningless, can be found in a large number of user habits and patterns by collecting the data.

He said people were puzzled by the massive numbers because they could not master the whole data but saw fragmented, scattered, local data. This is like usually "refining the data" and in the process of summing up often lose a lot of detail, but a lot of valuable information is hidden in specific details.

Baoliming suggests that for different value data to be differentiated, the value of the data is stored in a low-cost environment, but it will never be discarded, because in time, it will still have a certain value will be mined.

Privacy protection remains to be resolved

When it comes to the privacy scare over big data, Baoliming that the user's privacy should be protected, such as through data encryption, that only people who need to know the data understand, contact, or access the data. He wants the public to understand that, often through data mining software, the user data or information actually seen is not directed at a specific person.

He explained that many national legislatures or governments want to protect the user's information by enacting privacy laws. However, because of the lack of understanding of data analysis, some regulations may ultimately limit the user's use of information and data.

For example, in some countries, call records are kept for up to 90 days, this kind of call record can only be used for billing purposes, which restricts the telecom operators ' preservation of data, can not well design telecom products which meet the needs of consumers or users, and also brings a great limit to the pricing method, and then affects the market competition.

(Responsible editor: The good of the Legacy)