According to analysis, by 2020, the amount of data stored electronically in the world will reach 35ZB, which is 40 times times the global storage in 2009. At the end of 2010, according to IDC, global data volumes have reached 1.2 million PB, or 1.2ZB. If you burn the data on a DVD, you can stack the DVDs from the Earth to the moon and back (about 240,000 miles one way).
In the process of information construction, it is well known that the data can be divided into 3 kinds: structured data, semi-structured data and unstructured data. Among them, 85% of the data belong to the enterprise business process generated documents and other unstructured data.
Faced with a huge amount of data, people can not help but sigh, the big data era has come, pessimists deeply worried about management and maintenance, optimists see large data value. There is no uniform definition of "big data". It is generally believed that it is a mass of unstructured data, characterized by a large number of data, the form of data diversification. How do you store these fast-growing, massive amounts of data? How to analyze and process large data to find out value? A series of related issues has become a common challenge for all enterprises.
Challenges and goals of the big data age
Challenges in the big Data age include: how to achieve efficient, intelligent, large data storage? Unstructured data is showing a huge growth trend, how to effectively data management and application? Can existing data protection and document archiving mechanisms cope with growing volumes of data? How to conquer the difficult problem of mobile data management? How to achieve efficient data security in a complex data environment? Such problems are becoming a common challenge for all CIOs.
But we have found that the challenge to these big data is, in fact, summed up to only two goals:
1. The management of large data, from the production of large data, storage, protection, archiving to all aspects of security maintenance, fundamentally, this is the category of IT management maintenance, but the amount of data beyond the conventional management standards, the difficulty of management and maintenance of the leap-type rise in the situation;
2. The use of large data, which is the ultimate goal of enterprise management, large data means a large value, data and data, data and people, data and business relevance. This challenge is both liquidity, relevance, intelligent application challenges, but also based on large data depth mining challenges.
However, these two goals are not separate, but rather a complementary relationship, the management and maintenance of the purpose is to use, the use of the foundation is good management maintenance.
Second, cloud computing and large data, the intersection of the Times
In order to solve the challenges of large data, people naturally think of cloud computing, cloud computing encounter large data, this is the trend of the development of the Times. Cloud computing technology can realize the automation management and configuration of IT resources, reduce the complexity of IT management and improve the efficiency of resource utilization. For companies, the main form of cloud computing is the private cloud, whose main business is supported by private clouds, rather than the critical business or abrupt business that can take on public cloud resources. Private clouds and public clouds need to be seamlessly connected to form a mixed cloud environment.
Big data means big resources, this is the intersection of cloud computing and big data, which means that cloud computing has two directions in relation to large data, cloud computing can host large data, and large data can provide solutions through cloud computing architectures and models. In this way, we can clearly know that large data in the direction of management and application, through cloud computing resources sharing, high scalability, service characteristics to build and operate.
Large content of large data
If the intersection of large data and cloud computing is an external intersection, so large data within the association, Mining, is a large data content, this adjustment is far more than the application of cloud computing difficulty, data and data complex relationship, such as the cross application of structured data and unstructured data association; The storage of massive data and the sharing of data among people, the relationship between data (structured and unstructured) and business and decision making.
One way to address this is the idea of an information lifecycle that EMC has put forward, but in the view of many industry peers, the idea needs to be truly sublimated in the cloud and in the big data age, and that direction is intelligence, not single and local, but unified intelligence. IBM has put forward the wisdom of the Earth, as the emerging representative of the rise of love number is proposed intelligent data management solutions, but also based on the unified intelligence and information lifecycle ideas of the framework.
Undoubtedly, this is a new idea, according to love number related responsible person discloses, this kind of unified framework uses the cloud computing architecture, the main technical breakthrough in the resource pooling and the regulatory compliance, from the data generation stage will bring the large data into the life cycle management, through the Unified intelligence strategy, not only provides the very good transportation and the peacekeeping protection, It can also provide a unified data information platform in conjunction with business applications in the use and mining phase.
Iv. the way of data, outsmart the future
For a large data age, whether it is a business or a manufacturer, strategy, planning and thinking is the core, as with cloud computing, the large content of large data, need to have big thinking and high planning. The era of computing has made Wintel a group of manufacturers, the melody of that era is Moore's law; The Internet era is making achievements, including Google, FACEBOOK, Tencent as the representative of the new network, the main theme of the era of interoperability; the advent of the big data age has brought opportunities for more manufacturers, And the main tone of this era, understandable, intelligence will be in the mainstream. What is called, the way of data, outsmart the future.
(Responsible editor: The good of the Legacy)