Big Data age, in You and Me "side"

Book: The Age of Big data

Author: [English] Victor Maire-Schoenberg (Viktor mayer-schonberge)/Kenneth Couqueil (Kenneth cukier)

Financial Review

In the age of large data explosion, the difficulty of getting useful information out of the clutter of data is as difficult as trying to recreate a torn world map, and the book is like a portrait on the back of a map that tells you how to recognize large data and quickly spell the world map on the other side.

"Large data Age" by Victor Maire-Schoenberg and Kenneth Couqueil co-authored, the former known as "The Prophet of the Big Data Age", is one of the earliest data scientists to insight into the development trend of the big data era, he is not only a lot of world-renowned enterprises Trust Information Authority and consultant, It is also an information policy think-tank at the top of many institutions and national governments, the Economist data editor and one of the regular business and technical commentators of CNN, BBC and NPR.

The earlier fiery "cloud computing", "logistics network" is only exposed to the iceberg, and under the ice is TB (240), PB (250), EB (260) and even ZB (270) for the calculation of the magnitude of the large data. The book argues that big data is something that people can do on a large scale of data, a new approach to problem-solving based on new tools after highly developed information technology, which cannot be accomplished on the basis of small-scale data. The big Data age has challenged our lives and the way we communicate with the world, overturning the causal relationship that has always been our decision-making and understanding of reality, and moving on to relationships that simply need to know what is and not why.

When it comes to big data, you must first understand the "little data" era. Due to the limitations of tools and methods, only the church or government can do large-scale data collection and analysis, but the cost is rather high and timeliness is poor. To solve the problem, statisticians play a role in the use of random sampling to replace full data acquisition, but its success depends on the randomness of the sample selection, but in fact very difficult to achieve, once the sampling process has any bias, the analysis results will be very far. Come to the big Data era, due to the sufficient data processing and storage capacity, coupled with the most advanced analysis technology, can be done to give up the sample analysis of this shortcut, choose to collect comprehensive and complete data, that is, take a full data model "Sample = overall". More data brings more noise, but large data allows for imprecision, and argues that "obsession with accuracy is the product of a lack of information and a simulated era, and only by accepting imprecision can we open a window of a world that has never been set in."

Large data will cause the change of thinking, and in the drive of thinking change, will generate new business changes, "quantify everything" to become the core of the data: not only can the text into data, geographical location and even emotions can be data, which becomes a new perspective of the world as a message, as an understandable data of the ocean, How to use the massive data becomes the new commercial competition domain. The reuse, reorganization, expansion, depreciation, exhaust and opening of data innovation of "six-pulse Excalibur" bring new business models, and how to value the data will likely change the current accounting standards. In the big Data age, the 3 big components of the value chain will hold the entry threshold for the future, and it will be a big challenge for traditional companies to get a slice of the pie.

Big Data brings not only convenience and opportunity, but it also exposes us to the "Third Eye": Amazon watches our shopping habits, Google monitors our web browsing habits, and Weibo steals our social networks. For this reason, the author proposes to change the management of the large data age from 4 aspects: one is the protection of personal privacy, from personal permission to the data users to take responsibility; Secondly, individuals can and should be responsible for their behavior rather than inclination; third, to train the professional Data algorithm division to monitor the relevant companies to maintain public trust Four is as opposed to other commercial monopolies against data monopolies.

A rich and informative case is another aspect of the book. The introduction to Google in 2009 than the U.S. national CDC knew earlier the outbreak of swine flu outbreaks of time, the region caught the reader's curiosity; Apple's father, Steve Jobs, is the first person in the world to have the entire genetic code. The target department store in the United States had no knowledge of the daughter's pregnancy at all without communication with the customer; What impresses me most is that the reCAPTCHA project is using people to surf the internet and often encounter the opportunity to enter a CAPTCHA, will need to scan the file to be identified and explained in the fuzzy words to the input confirmation, and then Google bought the project company for its book scanning project, the annual savings of labor costs more than 1 billion dollars.

Although I had been quietly "invaded" by my computer when I was typing, but only then I know, I now play every word behind, are hiding a pair of invisible data grab hand, it guess and give the choice I have not finished spelling the next word this is the big data age, in your side. Wen/Jiang