BDTC ppt Collection (v): Challenges and prospects for large data

From the 2008 60-man "Hadoop in China" technology salon, to the current thousands of-person scale of the industry technology feast, the seven-year BDTC (large data technology conference) has fully witnessed the transformation of China's large data technology and applications, faithfully depicting the large data field of technology hotspots, Precipitated countless valuable industry experience. At the same time, from December 2014 12 to 14th, the largest China data technology event will continue to lead the current field of technology hotspots, sharing the industry experience.

In order to better understand the industry development trends, understanding the technical challenges of the Enterprise, in the eve of BDTC 2014, we will take you to the past assembly of the precipitation of knowledge mining, sharing the IT giants in the field of large data exploration road.

Large data for the development of enterprises a huge business opportunities, in the enterprise practice, large data face a variety of challenges, and its application prospects can not be underestimated, here will be sent to the previous China large Data technology conference PPT Highlights of the big data challenges and prospects.

The following are the challenges and prospects for the great data from the PPT of China's Big Data technology conference:

VMware Global Senior vice president Ronaldoama:future of Big Data analytics

PPT Download--The sixth session of the BDTC 2012

Ronaldo AMA thinks big data is good and can bring a lot of value. He first presented a panorama of the application of large data, from the real-time streaming technology, machine learning technology, real-time processing technology, data analysis technology and batch processing, and other areas of the development of a 3-tier model, the top is the deployment of cloud computing technology computing layer, in the middle of data storage and preprocessing of the data layer, At the bottom of nature is the infrastructure layer of many hosts and networks, obviously, to achieve these, such as operational dimension, high reliability, flexibility and flexible leasing need the support of virtual technology, and finally, how to implement, deploy virtualization framework and application, made a detailed description.

Shao, a researcher at Peking University "hundred People Plan": Opportunity and challenge of visualization analysis in large data age

PPT Download--The seventh session of the BDTC 2013

Shao introduces the connotation of "big data" and "visualization", especially pointing out that information graph is different from visualization, visualization is the process of establishing mental model or mental image for things, and needs more analysis and processing of data. Combining vivid cases, he led us to analyze the challenges that visualization faces in the big data age, there are: perceptible (to Beijing rental GPs and a location surrounding traffic for example), scalability, interactivity, from the user's perspective of scalability, visual system development. He also believes that visualization is a process of summarizing, mining, and returning data, a process from the whole to the local, to help understand how the world works. Finally, he stressed that China is still lack of large data visualization experts, and the United States and other countries, the gap is very large, although more and more companies focus on data visualization, but still stay in depth.

Alibaba data platform architect Liuchangyu: Ali Big Data Application Platform

PPT Download--The seventh session of the BDTC 2013

Alibaba data platform architect Liuchangyu is good at architecture design for large systems. Ali data Platform architecture using Data + cloud computing, around the data "save, pass, use", large-scale reduction of data use threshold, the more relevant data related to the value of the more valuable. The architecture of large data application platform mainly includes data import, data development, data production, data backflow, metadata Center and Data Quality Center, which is Liuchangyu in detail. Large data application platforms face many challenges in the future and need to be improved and upgraded in terms of stability, efficiency, openness, data quality, manageability, and ease of use.

Ministry of Industry and Information Technology Institute of Telecommunications Experts Weikai: Large data commercial use of policy control issues

PPT Download--The seventh session of the BDTC 2013

Information allows the material world to become computable, analyzed and predicted, when the potential of the material world becomes more and more difficult to excavate, through the guidance of data analysis to optimize the movement of the material world, is expected to open a vast new space for growth. This is the basic idea of big data. In large data applications, the Internet industry has pioneered the development of the road, in search engines, directional advertising, personalized recommendations and other applications to develop more mature, government, telecommunications, finance, retail and other industries are still in the difficult exploration, while the Internet enterprises to speed up the preemption of data portals, the construction of an ecosystem based on their own data platform Set up a data trading platform. Open source has lowered the entry threshold for large data technologies, but the leading Internet companies have advanced the technology industry for 8-10 years, and the gap has widened. In such a market environment, large data still faced with many of the market can not spontaneously solve the systemic challenges, which requires us to carry out in-depth thinking and practice.

Data Hall co-founder Xiao: Practice in Research data application and sharing

PPT Download--The seventh session of the BDTC 2013

Xiao mainly introduces the origin and characteristics of large data, the new thinking in the era of large data, the application and challenge of large data in scientific research field, the practice of data sharing service of scientific research and practice of data collection and processing service. He introduced a massive video, pictures, text, voice and social relations, more than 80% of the data belong to unstructured data, large data is different from the general physical resources, its value will not decrease with the increase in usage, data can be continuously integrated and processed, and constantly found new value. Any data-related services can occur in a centralized location and then provide the data to different systems and users without having to think about which data source the data comes from. The application of large data to ensure the availability and credibility of the data, in the future development, to achieve data sharing, Internet thinking to achieve data services.

Zhang, a professor at Ohio State University: challenges faced by parallel processing in large data analysis

PPT Download--The sixth session of the BDTC 2012

Zhang, Robert M. Critchfield professor of Engineering and President of the Department of Computer Science and engineering at Ohio State University, an IEEE partner, has long focused on high-performance computing and distributed systems. He described in detail the design and implementation of the system for overcoming the obstacles encountered in the analysis of large data by parallel processing: coordinate the user-controlled communication mechanism for large data analysis, and automatically transform data analysis and query requirements into software tools for optimizing analysis programs, and large data storage structures tailored to balance performance, scalability, and fault tolerance. In the age of "data is an important standard for testing truth", and also a data-driven era, we have proposed new requirements for algorithms, and system design has also evolved from scale-up models to BSP models to scale-out models.

CCF large Data expert committee Secretary-General Cheng: Challenges and trends in big data

PPT Download--The sixth session of the BDTC 2012

Cheng first introduced the origin and development of Hadoop and large data technology conference. In a speech to the General Assembly, he shared large data hotspots and future trends in research. Through the process of one months of research, proposal and expert voting, the large Data executive committee has selected eight problems of large data hotspots, including: the subject boundary problem of data science and large data, the basic model and paradigm problem of data calculation, the characteristics of large data and the problem of data state, the force and change reaction of large data, The security and privacy of large data, the challenge of large data to it technology, the application of large data and the problem of industrial chain, the ecological environment of large data. As for the development trend of large data, 37 items were extracted, and the overall situation was manifested in the data scale, data resource, data value highlighting, data privatization and Alliance sharing.

Percent founder/ceo Berlinson: Personalization--Large data navigator in the Dark Sea

PPT Download--The sixth session of the BDTC 2012

Berlinson, founder and CEO, has been focusing on personalized technology for years on algorithmic innovation, recommendation engine, cloud computing, mass data processing, artificial intelligence and its system implementation, leading a percentage of research and development teams to develop a variety of personalized algorithms based on content, user behavior and social networks. In this speech, he introduced big data from four aspects. First of all, it points out that large data technology and personalized technology are the two major technical directions in the future, and secondly, he thinks that personalization is the ultimate application of large data; third, he introduced large data and personalized practice of percentile; Finally, he shared the application of Hadoop in percentile data and personalization.

Professor Huang Yihua of Nanjing University: Technical Aspects and main research contents of large data research

PPT Download--The sixth session of the BDTC 2012

Dr. Huang Yihua, professor of computer science, Nanjing University. The main research direction for large-scale data parallel processing, cloud computing, web information extraction and mining technology, internet/web technology and applications, architecture and multi-core parallel computing, bioinformatics, information processing, Chinese and foreign academic journals and international conferences published more than 50 academic papers. In this speech, he mainly introduces the technical aspects and the hot research content of large data research. The research aspect mainly divides into the application layer, the algorithm layer, the system layer and the platform layer, he also takes "the application demand as the guidance, the discipline crosses as the bridge, the computing technology as the support" the development principle and the strategy, In this paper, 10 hot research problems of large data are introduced in detail.

Zhou Yinying, professor of East China Normal University: Hadoop and large data--an interpretation of a database scholar

PPT Download--The sixth session of the BDTC 2012

Zhou Yinying, professor and doctoral tutor of Software Institute of East China Normal University. In 1985 and 1988, Chengdu University of Science and Technology (now Sichuan) received a bachelor and master's degree in computer applications, from 1988 to 1990 at Chengdu University of Science and Technology as a teaching assistant. In his speech, Professor Zhou Yinying an attempt to understand Hadoop and "big Data" in the perspective of a database researcher. After several years of development, Hadoop has grown from a marginal technology to a de facto standard. "Big Data" is a worthy hot topic in it field this year. Hadoop has been a great success in dealing with Web page data, and the three word "big data" does not convey the exact semantics.

December 2014 12-14th, sponsored by the China Computer Society (CCF), CCF Large data Experts committee, the Chinese Academy of Sciences and CSDN jointly hosted the first China large Data technology conference (DA data Marvell Conference 2014,BDTC 2014) will be held in Beijing new Yunnan Crowne Plaza Grand Hotel. This Congress will focus on "big data Infrastructure", "large data ecosystem," large data core technology "," large data application of Internet technology Practice "," large data application of traditional enterprise technology "and other issues, nearly hundred experts will visit the scene, to share their technical combat. More concessions, speed to register!

China large Data Technology conference PPT Collection series articles

BDTC ppt Collection (i): BAT, Huawei, NetEase and other large-share data architecture

BDTC ppt Collection (ii): A large data architecture shared by Facebook, LinkedIn, etc.

BDTC ppt (iii): BAT, IBM, Intel shared large data technology

BDTC ppt Collection (iv): Tencent, Ali, such as the sharing of large data applications

BDTC ppt Collection (v): Challenges and prospects for large data

Free Subscription "CSDN cloud Computing (left) and csdn large data (right)" micro-letter public number, real-time grasp of first-hand cloud news, to understand the latest big data progress!

CSDN publishes related cloud computing information, such as virtualization, Docker, OpenStack, Cloudstack, and data centers, sharing Hadoop, Spark, Nosql/newsql, HBase, Impala, memory calculations, stream computing, Machine learning and intelligent algorithms and other related large data views, providing cloud computing and large data technology, platform, practice and industry information services.