Count large data areas to solve problems

Big data is now more than just the daily necessities of life, and many countries have started to move big data technology and applications to the national strategic level, and in March 2012, the U.S. government announced the rise of big data and related industries into a national strategy, with many industries including military, Energy has been included in the field of large data applications.

In fact, from the above we can see that the birth and development of large data brings us not only opportunities, at the same time in technology and application level users are also faced with a lot of challenges and difficulties, looking at the domestic market of large data, there are many industry pressure in front of us, In this issue, we will say that there are still some big problems facing the big data in the country.

Mixed data sources

As we all know, our country has a large population, the big data brings us the opportunity and the pressure is not small, as an emerging domain, although the big data means the big opportunity, has the huge application value, but also encounters the engineering technology, the management policy, the talented person training, the capital investment and so on many fields big challenge. Only by solving these basic challenges, can we make full use of this great opportunity, so that large data for the enterprise to give full play to the greatest value and contribution.

Rich data source is the prerequisite of the development of large data industry. And China's digital data resources are far lower than the United States and Europe, the annual new data volume is only 7% of the U.S., Europe's 12%, of which the government and the manufacturing industry data resource accumulation lags far behind abroad.

Now many enterprises are producing a lot of data at all times, but how to collect and refine these data is always a problem. The significance of large data technology does not lie in mastering the huge data information, but in the intelligent processing of the data, analyzing and digging out valuable information, but the prerequisite is how to obtain a large number of valuable data.

In the big data age, we need more comprehensive data to improve the accuracy of analysis predictions, so we need more convenient, inexpensive, automated data production tools. In addition to our online browsers intentionally or unintentionally documenting personal information, mobile phones, smart watches, smart bracelet and other wearable devices are also generating data at all times.

The complementary relationship between cloud computing platforms and large data is now common in the IT industry, with all kinds of web portals and ubiquitous sensors that collect, store, use, and share personal data, mostly in situations where people do not know.

Difficulties in building data analysis models

Now more and more users are trying to use large data analysis technology to solve a lot of problems, but large data, the General people think refers to its data scale of mass. With the technological revolution of data recording, acquiring and transmitting, the data is convenient and low-cost.

The real value of large data lies not in its size, but in its comprehensive: the multiple angles of the spatial dimension, the overlapping of multi-level information, and the continuous presentation of information associated with the activity of human or social organism in the time dimension.

To handle large data in a low-cost and scalable manner, this requires refactoring the entire IT architecture to develop advanced software platforms and algorithms. In this regard, the foreign once again walked in front of us. Especially in recent years, the development of open source model of Hadoop, such as large data processing software platform, and related industries have been initially formed in the United States.

User Rights and privacy balance

Many people now say "pale" when it comes to big data, one of the most important reasons is the disclosure of users ' privacy caused by large data mining and analysis technology. Some professionals point out that China has the largest population in the world, but 2010 China's new data storage is 250PB, only Japan's 60% and North America's 7%. China's data storage capacity reached 64EB in 2012, with 55% of the data needed to be protected at a certain level, but less than half of the data is currently protected.

I have written in the previous article, large data technology is actually a double-edged sword, how we in promoting the full liberalization of data, application and sharing of the effective protection of citizens, corporate privacy, and gradually strengthen privacy legislation, will be a big data age a major challenge.

The key to data increment is integration, but the prerequisite of free integration is the openness of data. In the age of large data, the significance of open data is not only to satisfy citizens ' right to know, but also to let the most important means of production and living data flow freely in large data age.

The difficulty of managing data

Massive data are mined, collected, stored, analyzed, and finally applied in different industries, and many of these steps need to be carefully planned in terms of management. As it is obvious, the user experience effect of large data is likely to directly affect some decisions of enterprises and individual users.

Large data can really play a role, a deeper look, but also to improve our management model, need to manage the way and structure with large data technology tools to match. Large data application area is still narrow, the application cost is too high, restricting large data application. The industry that can use the big data behind the domestic industry value mainly concentrates in the finance, the telecommunication, the energy, the securities, the tobacco and so on super large-scale profession.

Edited words

Large data technology, as the hottest it topic in the world, has already begun to be used in many industries and enterprises, and it is very important to look at the large data solutions of some leading enterprises in foreign countries, and the integration of cloud computing, virtualization and many other technologies Therefore, in the future domestic large data market development, the use of the high scalability of the cloud platform for flexible integration is we need to pay attention to.