Large data blue ocean being alienated core competitiveness

Since ancient times, there has never been a time when such large-scale data explosions have occurred. Today's business world has become a huge ship floating on the ocean of data, and companies that are able to sail into the blue sea through big numbers will reap the rewards.

The characteristics of large data

For the characteristics of large data, the industry usually uses volume, produced, Value, Velocity, 4 v to sum up. The characteristics of large data include: first, the amount of data volume is huge. Jumps from TB level to PB and even EB level. To see how much data is currently available, let's take a look at a set of formulas. 1024gb=1tb;1024tb=1pb;1024pb=1eb;1024 Eb=1zb;1024zb=yb. So far, all the printed material produced by human beings is 200PB, and the amount of data in all the words that mankind has said in history is about 5EB.

Second, the data types are numerous. This type of diversity also allows data to be divided into structured and unstructured data. More and more unstructured data are presented to all vendors in comparison with the previously stored text-oriented structured data. Thanks to the rapid development of Internet and communication technology in recent years, data types are already not a single form of text, in addition to web logs, audio, video, pictures, geographical information, and so many types of data processing capacity of data to put forward higher requirements.

Third, the value density is low. The value density is inversely proportional to the size of the total data. Take video as an example, an hour of video, in the continuous uninterrupted monitoring process, the data may be useful only two seconds. How to accomplish the value of the data more quickly through the powerful machine algorithm is a difficult problem to be solved in the background of large data surging.

Four, the processing speed is fast. This is the most salient feature of large data differentiation from traditional data mining. According to a report by IDC called the Digital universe, global data usage is expected to reach 35.2ZB by 2020. In the face of such a huge amount of data, the efficiency of processing data is the life of the enterprise.

Remember the rage American sitcom "Six People" (also known as "Friends") before 10? In the Classic of the American NBC television from 1994 to the end of 2004, the 6 protagonists have been delighted by fans since their names, careers and personal preferences.

One of the most popular and legendary mysteries of the American show is what does Chandler do? Although he has explained many times his work, no one has ever really figured out the full name he has done called "an executive specializing in statistical analysis and data reconfiguration" is something.

More than 10 years before the hit, it was not easy to talk to a stranger about a post that was linked to statistical analysis, so that by the end of the last two seasons of friends, "untimely" Chandler had to switch to advertising. But today, Chandler's career is getting hotter.

Now, in terms of numbers, fascination with data analysis will not only make a person another social alternative, but it means countless lucrative job opportunities are waving.

According to a 2011 report by McKinsey Global Cato, McKinsey's research department, the US needs 140,000 to 190,000 workers with "deep analysis" expertise, and 1.5 million more data-savvy managers, Whether it is a retired person or an employed person.

A notable backdrop for the demand for data talent is that today's "big data" explosion is getting more attention from the corporate to the government.

In February this year, the New York Times wrote that "big Data" is having an impact on every area, and that in business, economic and other areas, decision making will increasingly be based on data analysis rather than more experience and intuition than in the past. In areas such as public health and economic forecasts, the ability to anticipate "big data" has begun to emerge.

A recent example is Facebook's IPO on May 18. Before May 18, few dared to say that they were sure to predict the share price of Facebook on the day of the IPO, but Twitter did it miraculously.

DataSift, a social media monitoring platform, monitors Facebook's Twitter-related sentiment on the day of its IPO and its share price volatility. For example, Facebook's share price began to fall after 25 minutes after Facebook's sentiment on Twitter turned negative. And when the Twitter sentiment turned positive, Facebook's share price began to rebound in 8 minutes. Eventually, as the stock market closed, Twitter's emotions turned negative, and Facebook's share price began to fall after 10 minutes. The final conclusion is that every shift in sentiment on Twitter will affect Facebook's share price fluctuations, with a delay of only a few minutes to more than 20 minutes.

This is just one of many cases of "anticipating the future" based on large data generated by social networks, in fact the enormous commercial value of "Big data" has been thought to lead a huge change that would rival the 20th century computer revolution.

In February 2012, the Wall Street Journal published an article, "Technological change is about to lead a new economic boom," in a rare bold prediction: "We are once again at the beginning of three grand technological changes that may be enough to rival the 20th century revolution, where the epicenter of the three revolutions is in the United States, which are big data, The revolution in intelligent manufacturing and wireless networks. ”

The Wall Street Journal's assertions are not random. At the Davos forum in Switzerland earlier this year, a report titled Big Data, Big Impact, said the data had become a new category of economic assets, like money or gold.

More notable is the fact that the Obama administration has raised "big data" to the level of national strategy. According to the White House News of March 29 this year, the Obama administration announced an investment of 200 million dollars to launch a "Big Data research and development program." Hope to enhance the ability to collect massive data and analyze extraction information.

The last time the White House was personally involved in the promotion of the information technology industry or the "National Broadband Strategy" proposed by Hillary Clinton in 2010, the Big Data research and development program "is also considered a" hurricane Dash "at the U.S. government policy level after the" information superhighway "announced by U.S. Vice President Al Gore in 1993, and will" The big data "rise to national will will have far-reaching effects in the next 10 years."

20 years after the rapid development of Internet and communication technology, a "big data" era, really came.

(Responsible editor: Lu Guang)