Take you to see Big data

The music of the third wave

1980, the famous Futurist Toffler in the third wave of the book, the big Data enthusiastically praised as "the third wave of the CLS movement." Starting around 2009, "Big Data" has become a buzzword in the Internet Information technology industry.

What is Big Data

1980, the famous Futurist Toffler in the third wave of the book, the big Data enthusiastically praised as "the third wave of the CLS movement." Starting around 2009, "Big Data" has become a buzzword in the Internet Information technology industry.

Large data, or huge amount of data, massive data, is a large number of complex structure, the type of data set, is based on cloud computing data processing and application patterns, through the integration of data sharing, the formation of cross-reuse of intellectual resources and knowledge service capabilities.

There are research institutes that define "big data": "Big Data" is a huge, high growth rate and diverse information assets that require new processing models to have more decision-making power, insights and process optimization capabilities. In a way, large data is the frontier technique of data analysis. In short, the ability to quickly get valuable information from a variety of types of data is a big data technology.

Where does the big data come from?

The US Internet Data Center points out that data on the internet will grow by 50% a year, doubling every two years, and that more than 90% of the world's data are now in recent years. In addition, the world's industrial equipment, automobiles, electric meters have countless digital sensors, at any time to measure and pass on the location, movement, vibration, temperature, humidity and even the chemical changes in the air, but also produced a huge amount of data information.

Internet of Things, cloud computing, mobile networks, car networking, mobile phones, Tablet PCs, PCs, and a variety of sensors, none of which are data sources or hosting methods.

How big is the big data?

The internet alone, for example, can produce 168 million DVDs a day, 294 billion more emails, and 2 million more community posts, equivalent to TIME Magazine's 770-year text ... and the internet is full of content.

As of 2012, data volumes have jumped from TB (1024GB=1TB) levels to PB (1024TB=1PB), EB (1024PB=1EB) and ZB (1024EB=1ZB) levels. International Data Corporation (IDC) research results show that 2008 global data volume of up to 1.82ZB, equivalent to the global output of more than 200GB of data. By 2012, the volume of all printed materials produced by human beings was 200PB, and the amount of data in all the words in human history was about 5EB. According to the IBM study, 90% of all the data available to the entire human civilization have been generated in the past two years. By the year 2020, the world's data will be 44 times times the size of today's.

"4 V" of large data

The 4 "V" of large data refers to 4 characteristics of large data: First, the volume of data is huge. Jump from TB level to PB level; second, there is a wide range of data types and data from a variety of sources. Third, the value density is low, the commercial value is high. In video, for example, a continuous uninterrupted monitoring process may be useful for only two seconds. Four, the processing speed is fast. Usually in the second-level time range to give analysis results, the time is too long to lose value. This speed requirement is the biggest difference between large data processing technology and traditional mining technology.

As a result, the industry has summed up the characteristics of large data into 4 "V"--volume (Large), velocity (high-speed), produced (diverse), veracity (accurate).

What is cloud computing?

Cloud computing (cloud computing) is the use of the Internet to integrate a number of lower-cost computing entities into a perfect system with powerful computing power. The simple understanding is that the operating company provides servers, applications, storage space, users telnet to the server over the network, and uses these storage space and applications as needed. Narrow cloud computing refers to the delivery and usage patterns of IT infrastructure, which means acquiring the required resources through the network on an as-needed and extensible basis; broad cloud computing refers to the delivery and usage patterns of services, which refer to the required and extensible way of obtaining the services through the network. It means that computing power can also be used as a commodity to circulate and trade through the Internet.

Large data and cloud computing

Technically, the relationship between big data and cloud computing is as inseparable as the pros and cons of a coin. Large data must not be processed by a single computer, and a distributed computing architecture is required. It features a huge amount of data mining, but it must rely on the cloud computing distributed processing, distributed database, cloud storage and virtualization technology.

Oil and gold in the digital age

In a minute, Twitter has more than 100,000 new data, and social networking "Facebook" has more than 6 million visitors.

Huge amount of data, what does that mean?

The impact of large data on socio-economic life is not limited to the technical level, it provides us with a new way to look at the world, that decision behavior will increasingly be based on data analysis, rather than in the past with more experience and intuition to make.

"This is a revolution, and huge data resources have led to a process of quantification in all areas, whether academia, business or government, and all fields will begin." "said Gari Kim, a sociology professor at Harvard University.

Industry insiders point out that big data is a new way to get rich, and its value is comparable to oil and gold.

While large data is still at an early stage in the country, commercial value has emerged. First, the companies that hold the data are standing on the gold mine, which can produce good results based on data transactions, and secondly, there are many business models based on data mining, different positioning angles, or focus on data analysis. For example, to help enterprises do internal data mining, or focus on optimization, to help enterprises more accurate to find users, reduce marketing costs, improve sales rate, increase profits.

Data-

The biggest trading commodity of the future

In the future, data could become the biggest trading commodity.

"Data will be the fundamental determinant of success in all industries, and the final data will be a vital natural resource for mankind," said Rometty, IBM's executive director. ”

The value of large data is to obtain the maximum data value through data sharing and cross multiplexing. McKinsey predicts that the future of big data products in the three major industries will generate 700 billion of dollars in potential market, China's large data products, the potential market size is expected to reach 1.57 trillion yuan, to the IT industry to open up a new golden age.

Big data is rebuilding many traditional industries. By collecting and collating the data of every aspect of life, and analyzing and excavating it, we can get valuable information from it and finally develop a new business model. The location of the flagship stores, such as McDonald's, KFC and Apple, is based on data analysis. In the retail industry, data analysis technology and means more widely used, excellent Amazon, Taobao, etc. through the vast number of data control and analysis, to provide users with more professional and personalized service.

At the same time, large data in the social management, but also has irreplaceable important value.