A brief analysis of the future development trend of large data

Large data analysis is often associated with cloud computing, because real-time large dataset analysis requires a framework like MapReduce to allocate work to dozens of, hundreds of, or even thousands of of computers.

The impact of the European debt crisis has led to a cautious attitude towards it investment from the global IT companies starting in the third quarter of last year. However, Cao Yuchin said, from the technical input point of view, although we see the global IT spending more cautious attitude, but this does not affect the industry for large data input, investment, we believe that large data in the industry is a rapid development process. Large data is mainly to help enterprises in the existing data, the data produced by the integration of the corresponding small amount of input to get greater returns.

Sun Boke Frankly, I spent most of my career doing data and data-related technologies. At this point, it was the most exciting moment for a data person like me. Because the database, large data has become the center of change, in fact can become a revolution in the IT sector, manufacturing, retailing, government management, technology, etc., big data changes the way the whole world.

As of 2012, data volumes have jumped from TB (1024GB=1TB) levels to PB (1024TB=1PB), EB (1024PB=1EB) and ZB (1024EB=1ZB) levels. International Data Company (IDC) research results show that 2008 global data volume for the 0.49zb,2009 years of data for the 0.8zb,2010 annual growth of the number of 1.2zb,2011 years is as high as 1.82ZB, equivalent to the global output of more than 200GB per person data. By 2012, the volume of all printed materials produced by human beings was 200PB, and the amount of data in all the words in human history was about 5EB. According to the IBM study, 90% of all the data available to the entire human civilization have been generated in the past two years. And by the year 2020, the world will produce 44 times times the size of today's data.

On the big data development trend, Liu Software general manager, said confidently, in the large data age, data analysis means is the key, only through data analysis can bring value. Traditional data analysis capabilities, can not handle such a large number of data, we usually analyze tens of millions of data or hundreds of billions of data, it will take dozens of hours (several days) time to get results. When the data reaches 1 billion, the software can not run at all, sometimes for dozens of days, this speed people are unacceptable. So, in the new era, we need high-performance analysis software.

IDC has a number, global data usage to 2020 days will increase 44 times times, this a very large growth. Ling, China director of the Intel Industry Cooperation and Solutions division, said that we believe that 44 times times the growth, the main source of growth will be large data forms. The traditional relational data will still grow, but its growth has reached a comparatively mature stage in the application and use of the traditional relational database today. If we are interested in making some contribution in this, creating new business models and business opportunities, we want to invest more in the big data.

(Responsible editor: The good of the Legacy)