Hadoop becomes the key to opening big data

November 2013 22-23rd, as the only large-scale industry event dedicated to the sharing of Hadoop technology and applications, the 2013 Hadoop China Technology Summit (Chinese Hadoop Summit 2013) was held at four points by Sheraton Beijing Group Hotel. Nearly thousands of CIOs, CTO, architects, IT managers, consultants, engineers, enthusiasts for Hadoop technology, and it vendors and technologists engaged in Hadoop research and promotion will be involved in a range of industries from home and abroad.

The Hadoop China Technology Summit was hosted by the Chinese Hadoop summit Committee of Experts, supported by IT168, Itpub and Chinaunix, and managed by the drainage media. The conference will uphold the theme of "effectiveness, application and innovation", aiming to promote the ability and level of Chinese enterprise users to improve the application of Hadoop, reduce the application threshold of Hadoop technology and the threshold of investment budget, and popularize the application value of large data through open and extensive sharing and exchange. The following is the transcript of the speech by Mr. Gang, Vice president and chief scientist of Jingdong Technology.

▲ Beijing-East Technology vice president and Chief Scientist Gang

Since 2010, with the maturity of social networking, the rapid development of mobile Internet, the strong growth of network shopping, as well as the wide application of cloud computing and Internet of Things, have produced more and more complex applications, and have enabled more mobile devices and intelligent terminals to be connected to the network, and individual families and enterprises have basically realized the 24-hour online status The resulting data and growth rate are faster than in the history period. The amount of information is growing at a rate of 59% per year, and IDC's research on global data is doubling about every two years, and the total amount of storage in the world is expected to reach 35 GB in 2020.

User's documents, network content, social media and so on, the format of the data is increasingly rich, semi-structured and unstructured data is also a geometric growth, data acquisition and processing must be real-time and rapid, in short, a large number of diverse and real-time is a significant data characteristics.

China, as one of the world's largest countries, as a few rapidly developing economies, the size of domestic Internet users, mobile users, the size of intelligent end-user and the growth rate in the world is the leading. The informatization of enterprises and government has the breadth and depth of excavation, which means that China's data market is the largest data gold deposit in the world. Perhaps the 2012-year high-tyrants buzzword and the 2013 dick and the old can talk to you about big data. The 2013 is the national Big data age has risen to the strategy, Obama will be a big data strategy to the national will, this is the future of "new oil", will become an important component of comprehensive national strength.

The future possession and control of data will even become a road power, another kind of national assets other than sea and air rights, with the explosion of data, data collection, mining, sharing and other tasks will be a challenge to launch the whole body, human can discover new knowledge and value, bring great science and technology, great knowledge, great development.

This year's big data also entered the Chinese government's vision, Guangzhou and Chongqing issued a big government data plan, 13 plenary more mention statistics, taxation, real estate and other key areas of the unified data platform, large data is to promote the government's transformation of the important ritual. Big data will also be China's national strategy.

We are in front of a very large volume of data sets, collection, storage, computing is not previously completed, 2006, the birth of Hadoop, with more and more users to join, continuous use of contributions and improve, forming a strong ecological enterprise, starting from 09 with the cloud computing and large data rapid development, Hadoop, as the best solution for massive data analysis, is beginning to be the focus of it vendors and internet companies, with many of the business versions of Hadoop and the products that support Hadoop, such as Yahoo running with 4,000-node clusters, including storage logs and data, Hadoop technology, with its ability to correlate structured and unstructured data, is an important technical tool for the global data industry, with its advantages of low cost, high reliability, and high performance.

The domestic application based on Hadoop has also been on the ground, especially in the field of Internet, proficient in the field of advertising and search for a wide range of Hadoop technology, the Jingdong Mall Hadoop Mall is also the application of warehousing and distribution data, Chinese universities and research institutes have done research based on Hadoop, including system optimization and security, and are giving back to the Hadoop community in the form of open source. New business models will continue to emerge, Hadoop is also in the telecommunications, E-commerce, bio-pharmaceutical and other areas to expand, I believe that China's large data fertile ground, relying on all peer creative work, Hadoop technology will continue to improve, Hadoop business projects will be everywhere, For the development of China's large data industry to provide more impetus.

Everyone, the big data wave has been irreversible, with Hadoop as the representative of the technology to promote the history of the wheel, let us work together to complete our historical mission, my speech to this end, and wish the General Assembly successfully convened, thank you!