Big data needs to be omitted.

Similar to the problems that cloud computing encountered at the beginning, big data is also faced with the problem of "Implementation. On the basis of recognizing the importance and necessity of big data, what enterprises need to do is to manage big data more intelligently and innovate in big data applications and business models.

On April 9, 2014, the China Big Data International Summit Forum was held in Shanghai. The reporter interviewed several guests at random. They said in a similar speech: the most urgent task of big data is to accelerate implementation, so we cannot simply talk about concepts, the key is to use big data to serve the business and promote application innovation.

　Don't be too impetuous

"Impetuous": This is the overall feeling of Lei Tao, CEO of tianyun big data, on China's big data market. Chinese users have gradually realized the importance of big data and began to try to process and analyze big data, such as using hadoop, memory computing, and other technologies to build a distributed big data platform, some telecom operators process tens of billions of data records per day, and tianyun big data helps *** use hadoop in its core system. However, most users still habitually combine big data with Bi (Business Intelligence) to process big data in the old way of Bi. Lei Tao believes that this approach is problematic for big data, both in ideology and in practice. "We have entered the data technology era. After building an appropriate big data infrastructure platform, we must learn how to process data more intelligently. In the IT age, people pay more attention to technology, while in the DT age, information is the core ."

Jiang Qi, co-founder and vice president of Beijing tengyun Tianxia Technology Co., Ltd. (talkingdata), also believes that there are many big data slogans currently, there are still few big data applications and successful business models. "We tried to use mobile big data for risk control. Although it was difficult to implement and there was a risk of failure, we still tried it bravely ." Jiang Qi said, "At the beginning, the new demands that users constantly create prompted us to continuously improve our products and add new features. Later, we observed some new data consumption requirements. Therefore, on the basis of developing a general mobile big data platform, many vertical applications were added, continue to explore the game, e-commerce, financial and other market segments."

"In terms of big data, what we lack is basic knowledge education, as well as Big Data Implementation and Application Experience ." Liu Zhengyu, general manager of saesz (SAS) software research and development (Beijing) Co., Ltd., said, "The emergence of big data is not a substitute for traditional structured data analysis, but a useful supplement. You cannot simply emphasize the strengths of big data in processing unstructured data, but ignore or discard the analysis of structured data. To realize the value of big data, we still need to rely on the original technical basis ."

　The value of big data is gradually becoming apparent

The mobile Internet field is the frontier of big data applications. Founded in 2011, talkingdata is an independent company that provides mobile big data services. By the end of July this year, the data service of talkingdata had covered 0.8 billion terminal devices. "In the past, an app development team had no channels to learn about the download and usage of the apps it developed. We provide a cloud-based analysis platform that can extract and analyze app user behavior data from terminals and then feedback the results to the app development team, which is conducive to product iteration ." Jiang Qi said, "We currently support more than 40 thousand applications. Didi chuxing, jumeiyou and many well-known game manufacturers are our users ."

The target customer group of talkingdata is very clear, that is, individual consumers. Jiang Qi believes that only by providing services to individual consumers can the value of big data be truly presented. Although it serves individual consumers, talkingdata partners with enterprise users. Helping these enterprises understand their customers and implementing precision marketing is the main task of talkingdata. For example, Jiang Qi said that in the past, the offline card issuance method was adopted. Due to the long card activation cycle, China Merchants Bank's credit card activation rate was only about 30%. China Merchants Bank hopes to switch to online card issuance, but it is still suffering from no good way to evaluate credit risk. Based on the home address, Organization address, and MAC address of the mobile device submitted by the credit card applicant, talkingdata uses advanced algorithms to reverse push and verify that the information submitted by the credit card applicant is correct, this process takes only three to five minutes.

Using the "de-sensitive" data obtained from terminal devices, talkingdata can calculate the personal information and preferences of the device owner, and then provide the information to users in traditional industries, help them realize business value-added. Jiang Qi said: "In the future, we hope to make further improvements in machine learning, intelligent mining, and other technologies, while making new breakthroughs in algorithms ."

SAS has advanced technologies and comprehensive solutions for structured data analysis. Liu Zheng believes that SAS can effectively solve the big data "big" problem. It takes a long time to process hundreds of rows of data in the traditional way. However, the multi-thread and distributed processing method can greatly improve the data processing efficiency. "The traditional way of working is to read data from the database, and then model and analyze the data. Now, we put the computing model into the database, without extracting data, we can complete data processing and analysis in the database, thus improving the speed of data processing and analysis. With the memory processing technology, we can process data in real time ." Liu Zheng said, "We can combine visualization technology with memory technology to scan all data in a few seconds and get real-time processing results, this makes big data analysis very simple, just like using a dummies camera."

Big Data has a positive impact on all walks of life. People began to use big data to assist in decision-making and achieved good results.

　　Evolution of data visualization

Data Visualization at the top of the big data ecosystem has attracted more and more attention. SAS companies that have some experience in real-time data processing also fully demonstrated its speed advantages in data visualization. According to Liu Zheng, SAS uses memory computing and other technologies for data visualization. Even if more than 1 billion rows of data are processed, the results can be obtained in real time. SAS integrates real-time data processing and analysis with data visualization technology.

Datawatch, which has more than 20 years of experience in data visualization, entered the Chinese market through its only partner in China, tai'an financial education group. Karl mouantri, managing director of datawatch, said that industry customers such as telecom and retail who want to promote their business development through big data will first use data visualization tools. In the world, many well-known financial enterprises, IT companies and major customers in traditional industries such as Boeing and Walmart use datawatch data visualization tools. Guotai financial education group integrates its accumulated industry data with datawatch's data visualization tools to provide solutions for scientific research data analysis of the Chinese Emy of sciences. In the Chinese market, datawatch is not eager for immediate success. They hope to cooperate with companies that have both foresight and deep accumulation in finance and education industries like tai'an financial education group, in addition, we have started from Chinese universities to enhance education and training for students so that they can gain a deeper understanding of data visualization.

Karl mouantri has always stressed that datawatch is a disruptive and innovative company with unique advantages in real-time Big Data Processing and visualization technologies. Datawatch provides visual data analysis, comprehensive data filtering, and alarm functions to process data from different sources. "We can process pre-cleaned data or directly collect raw data ." Karl mouantri said, "Some cleaned data may lose some important information. To get more accurate analysis results, we can directly capture the original data for processing and presentation ."

Karl mouantri believes that data visualization is necessary for big data. Data Visualization not only serves the enterprise's senior management personnel, but also is an essential tool for the enterprise's grassroots employees. For example, employees engaged in O & M and warehousing also need to view the business progress in real time. Karl mouantri, for example, said that in the United States, the Walmart supermarket needs to check the goods three times a day, early, mid, and late, to check for missing items. Therefore, they require real-time data processing and visualization tools of datawatch to monitor the situation of thousands of products in real time. "We want to bring this successful experience from Walmart to China ." Karl mouantri.

However, Lei Tao has different opinions on the role and necessity of data visualization. He believes that from data collection, storage, processing, analysis, and visualization, This is the traditional bi idea. However, in the DT era, corporate decisions must be flat and services must be sunk.

"We helped a customer in the insurance industry to implement database preconditions and direct the results of big data analysis to 0.18 million sales representatives. The analysis result is just a simple prompt, that is, the customer that a salesperson should pay attention. In this case, the traditional data dashboard is useless ." Lei Tao said, "nowadays, a large amount of data comes from IOT, and traditional data visualization tools are powerless. We must adopt new architectures and tools ."

　　Link

The 2014 China Big Data international summit was jointly sponsored by Shenzhen Institute of Advanced Technology, Chinese Emy of sciences, China Institute of quantum investment, School of Management, Fudan University, Shanghai Securities News and datawatch, more than 500 domestic and foreign top experts and scholars in the big data industry and academia, as well as representatives from domestic IT, finance, education, medical, and other fields, have gathered to discuss the development of the big data industry, share big data applications and innovation achievements, analyze data analysis problems in various industries, and seek solutions.

With the topic "Big Data innovation, breakthrough, and soaring", the Forum adopts the form of thematic reports and special forums. During the same period, the Conference also held a high-level seminar on big data technology and application. The seminar was sponsored by Cathay Pacific anjin Rong Big Data Research Center, Shenzhen Institute of Advanced Technology, Chinese Emy of sciences. It hired renowned big data experts and academic scholars from China and abroad as training lecturers. This will bring positive significance to the cultivation of big data talents, efficient enterprise management, and innovative development of colleges and universities.

This article from the "Guo Tao's storage world" blog, please be sure to keep this source http://gtstorageworld.blog.51cto.com/908359/1550310

Big data needs to be omitted.