Challenges and opportunities brought by big data age

The advent of the Big Data era has posed a new challenge to human data control capabilities, but it has also provided unprecedented space and potential for people to gain deeper and comprehensive insights.

Gary King, a professor of sociology at Harvard University, said: "This is a revolution. The huge data resources that have led to the beginning of a quantitative process in all fields begin in all fields, academically, business and government."

"The eco-environment in the big data industry is accelerating." Mr. Li Xiaohua, vice president of the Internet of Things Division of Tongfang Co., Ltd., said in a 2013 partner conference entitled "Embracing a Big Data-Win-Win New Era," This made a detailed analysis.

First look at the social environment. Information technology to integration, wisdom, green direction. With the development of cloud computing and mobile Internet and the emergence of new management and business models, big data can create greater value and enhance social management and efficiency. Throughout the history of industrial economic development, the technologies that bring applications will certainly be able to develop a thriving industry.

Look at the policy environment. The government attaches great importance to the development of strategic objectives clear and definite. Recently released a series of policies to promote the development of big data industry. In the "12th Five-Year Strategic Plan for Emerging Industries," it is pointed out that strengthening the development of technical software represented by mass data processing software and "Big Data Information Processing" in the "Twelfth Five-Year Development of Industrial Networks" are regarded as four key technological innovation projects ; "National Development and Reform Commission's Opinions on Strengthening and Improving the Management of National E-government Construction Projects" stressed that the construction of government data centers should focus on the top-level design and shift to coordinated and cross-departmental and inter-regional cooperation and resource sharing.

Market environment. Great prospects, vast space. Combined with the research on the relevant Chinese market, IDC believes that China has great market potential in the field of big data. More and more IT providers regard China as a hot spot for the development of big data services. China is already the largest market for PCs and smartphones in the world, and China has the largest number of Internet users and mobile Internet users in the world. These end devices create data on the Internet, all the time. Large data capacity not only makes a lot of international manufacturers value the Chinese market, but also makes China's big data applications have different characteristics from abroad, big data opportunities are right in front of us.

"Data, which has infiltrated every industry and business intelligence area of ​​our time, has become an important factor in production, and the excavation and use of vast amounts of data signals a new wave of productivity growth and a wave of consumer surges," McKinsey said.

The significance of data mining

This is a story about retail empire Wal-Mart.

Wal-Mart, the world's largest retailer, shares the same number of employees as the federal government in the United States. Its revenue exceeded 400 billion U.S. dollars in 2010, surpassing that of many countries. After a routine data analysis, the researchers suddenly found that the diapers with the purchase of the most products even turned out to be beer! This relationship is puzzling, diapers drink beer, it is a real law? ?

After follow-up investigation, the researchers finally found a cause. Some young dads often go to the supermarket to buy baby diapers, and 30% -40% of dads will try their best to buy beer for themselves. Wal-Mart then bundles beer and diapers. Unexpectedly, both sales have increased.

This is the result of mining historical data, reflecting the data level rules. Wal-Mart is one of the earliest enterprises in the world to apply data mining technology and is also a master of data mining technology.

Data Mining refers to the automatic analysis of a large amount of data through a specific computer algorithm to reveal hidden relationships, patterns and trends among data, and to provide decision makers with new knowledge. Data mining expands the scope of data analysis from "known" to "unknown," from "the past" to "the future," and its development and maturation ultimately leads to the widespread use of "big data" in all walks of life .

As the Times of New York said in a February 2012 column, the era of "big data" has come, and in business, economics and other areas, decision-making will increasingly be based on data and analysis rather than on experience and intuition . With the popularization of information management system, the scale of the enterprise is getting bigger and bigger, the organization becomes more and more complicated, the market is more changeable, the competition is fiercer, the information is timely and accurate, the decision-making is correct and reasonable, Big, one-step mistake may lose all.

Data services in decision making

Big data is overwhelming, but not easy to practice. Herbert Simon, the world's most influential scientist in the 20th century, predicted that in the post-industrial era, in the information age, the central issue facing human society will shift from how to increase productivity to how to be better The use of information to support decision-making.

How to transform data and information into knowledge, expand the human rationality, and help decision-making? How to extract and integrate valuable data from each independent information system so as to realize the data from data to knowledge, from information to knowledge, from knowledge to profit Conversion?

In the face of reporters' questions, Zhou Xia, vice president of Tongfang, and Li Xiaohua, deputy general manager of Internet of Things Division, made in-depth interpretations of the concept of Tongfang Big Data.

The big data strategy put forward by Tongfang based on the "data resource system" has made up for the gap in management and decision-making support in different industries in the past. Six product application platforms for typical business needs are the six most important nodes in the entire data generation-to-service process, with each offering a range of products. A series of lively practices and advanced technical concepts of "index system", "top-level design" and "independence from the industry" are sufficient for enterprises and institutions to have "evidence" to be able to implement in the specific business.

The data resource system is industry-independent, which is the core of the Big Data concept. The way to do this is to build a generic, industry-independent data production process - taking the same data resources across different industries. Although different industries have different businesses, the data generated and the forms of management they support can vary widely, but from the data acquisition, data integration, data processing, integrated data applications, data services and promotion, the lifeline of data processing Process to analyze the pattern of all industries are the same. If we increase the system of data resources between business and management in different industries and work through the data processing of data resource systems to link today's data with historical data and link the present data with the indicators that leaders and business organizations care about, Business-oriented data into management-oriented data, to assist in the decision-making leadership, the real change from data to knowledge, such a data resource system is very suitable for management and decision-making use.

Zhou Xia, vice president of the same side, said that the data generated value, not the big data itself can be solved. First of all, the data should be organized into a data resource system, and then the data should be divided into different levels and categories. At the same time, the correlation between data and data should be marked out. This correlation is the core of the objective phenomenon. On this basis, by analyzing the degree of business docking between data resources and related departments, we can give play to the role of data resource system in management, decision-making, monitoring and evaluation so as to generate great value for big data and provide service basis for decision making .

Li Xiaohua, vice president of the Internet of Things Industry Division, further introduced to reporters the process of data processing with the same data source system - Tongfang helps enterprises to establish the concept of data center construction and builds supporting mechanisms under the guidance of concept. Through this mechanism and related data, Docking, through the docking results in different management levels set up an indicator system, the index system to create a monitoring and evaluation mechanism. It is noteworthy that the indicator system is constantly changing with the specific circumstances, changes in the index system will lead the subsequent business and data automatically to adapt to the new indicator system, which is a closed-loop system, in a closed-loop system, companies Can find its own goals and target deviation, and can make new decisions based on the target deviation, in order to reduce the loss caused by the target deviation. In this way, a recycle ecosystem is formed to help the healthy development of the enterprise.