Talking about large data: efficient data storage, maintenance and analysis

"Big Data" is thought to be a technology that can reshape existing data centers. Admittedly, the data center doesn't sound as interesting as the ipad, but without the data center's support for cloud computing, the ipad will not be as interesting as it is now. Cloud computing is not only a huge extension of the mobile Internet, but it is becoming the backbone of a rising new era, constantly injecting vitality into commercial terminals. Http://www.aliyun.com/zixun/aggregation/10075.html "> The U.S. government has realised the importance of big data, and President Obama has even spent 200 million dollars on the federal budget for big data projects. Whether it is business people or government agencies are talking about big data, as if this is a beacon of the world, as if the task of economic development on the shoulders of large data.

But wait a minute, do these people, business people or government officials, who are so admired for big data, really understand the nature of big data? Is big data really a panacea, or do we overestimate its value and ability? In fact, these people's understanding of large data stems from their different channels, limited by the influence of their suppliers. Until now, the Internet has not yet on the big data "what, what can do" have an intuitive, understandable, definite explanation. Therefore, we should first find out: What is the big data, what is the nature of the big data? If you do not make it clear and blindly invest a lot of money, the consequences will be very serious.

With the development of the Internet, a large number of enterprises are facing new challenges, the traditional database in many cases has been unable to meet the needs of enterprises and users. Hadoop, a Open-source project from Yahoo, has become its own business industry. A survey of 154 U.S. small and medium business owners in the reading and writing network shows that for the definition of large data, most business owners are interpreting the word based on their own experiences and strategies. 28% of those surveyed said they recognized "massive and rapidly increasing data transmission" The 24% tune shows that the Big Data "is a new technology designed to address the increasing challenges of data in volume, type and speed," and 19% that large data is intended to meet "the need to manage and follow storage and archiving data", 18% of respondents said the big data was "a big bang for the new data".

All these answers, what exactly is the correct answer? Scott M. Fulton, author of several teaching books and resources. A lot of recycled products, from crates to park benches, are made from his teaching books. He gave a universal definition of "big data":

Although database technology has touched the ceiling at the business logic level (this logic is still using inefficient energy to access and maintain data), this inefficiency has been well masked by the increased hardware speed and capabilities and the declining storage prices. So until 2007, no one has been able to seriously deal with this problem. This inefficiency is finally exposed in the process of doing a lot of data analysis to extrapolate results. As a result, big data came into being.

In essence, large data tools indicate how large amounts of data are stored, maintained, and analyzed. They may not completely replace traditional databases, but at least a storage system like Hadoop replaces the way data is accessed.

(Responsible editor: The good of the Legacy)