For many people, the term "big data" refers to an algorithm or software program that helps businesses or researchers find hidden trends that can help them make better visual data analysis.
But in fact, it has another meaning. The literal meaning of large data is more emphasis on the huge amount of data, the dazzling mass of http://www.aliyun.com/zixun/aggregation/23653.html "> Customer information, audio recording, image, text information, Facebook messages and retrieval of stored technical information, and appropriate analysis for any user based on their needs.
You can't put aside the second layer of meaning and consider only the first level. In fact, how to retrieve data has become the biggest challenge, at the same time, the High-tech industry's biggest opportunity.
For many people, toner copies seem to be as old as gray boards and scribes, but digital storage has been a recent event. In 1993, only 3% of the world's information was stored on digital devices such as hard disks or optical discs, according to a paper written last year by Martinhilbert and Priscilalopez, published in the journal Science. Prior to 18, tape and silicone disks assumed the larger role of storing information at the time (about 6%). According to Hilbert and Priscila's paper, in the first internet wave of the 2000, digital storage accounted for only 25% of the world's information storage, and 2002 was the first year in which the number of stored storage was more than traditional paper, vintage tapes and other analog storage devices.
But by 2007, DVDs, CDs, memory cards and other digital storage devices accounted for 94% of the world's share of information storage. Only hard disk storage jumped to 52% from 5% of the total 7 years ago. 2007, the global total storage capacity reached 295 bytes (EB). Imagine that every e-mail message or text message is created as a data file on multiple computers at the same time.
That was 5 years ago, and by the year 2012, the global total digital information capacity reached 2.7 kilobytes (ZB), that is, 2.7 followed by 21 zeros. According to IDC, an increase of 48% from 2011, of which 90% of the data is unstructured, such as digital video, sound and image files, and how to query and retrieve them poses a great challenge.
New applications abound
So how do you deal with the wave of information generated by sensors, telephones and computers? Some of the corresponding applications emerge. Forecasters predict the weather better by the number of tiny particles in the air. Wind or solar power plants will also make full use of accurate dynamic numbers
According to the drive forecast system, the estimated future power output, thus can maximize their investment in other energy direction of return. Suddenly, the wind became predictable.
In addition, data collected from various vehicles, including cruise speed, location, start-up and parking, can provide traffic planners and the public with real-time road information. Over time, through the accumulation of a large number of daily traffic information law excavation, can be for the future of highway and car park planning to provide decision support to reduce potential congestion. To do this, your car will have its own mobile phone and continue to communicate with the outside world.
There are more popular applications, and some retailers want to do data mining on their security cameras and mobile sensors. This is not really about catching a thief, but trying to find out why some shelves are attractive to customers, and others are not.
Businesses and customers are becoming more and more impatient. Waiting in line for 8 seconds in a bank is lucky, but waiting 8 seconds on the internet is a long way off.
Storage needs to build a holistic view
To meet this demand, the storage industry needs to change its view of storage as just a collection device, and should start to see hard drives, flash memory, tape storage, and data center storage systems as a whole.
From a certain point of view, the assumption of data structure, customers have come to the front of the storage enterprise. For example, large web site assets, E-commerce Networks, have started to use a combination of flash, tape dram memory in back-end operations to optimize speed, data retrieval, or integrated efficiency. The storage structure of different industries or different companies has different characteristics. The dynamic nature of the storage structure becomes easier to understand, and the data retrieval architecture becomes a tool to build competitive advantage.
Mobile technology will be a hotbed of application development. Users want lightweight devices that do not require a large amount of battery capacity but can store huge amounts of data. This is a paradox, but using the right storage structure, this carrier can be carefully designed to set the local storage and cloud storage data Services mixed services, so as to optimize the transmission of data. Similarly, manufacturers have had to invest more in storage capacity. Few investors and companies like to taste the process of paving cement on the ground, but this is necessary. Hard disk industry quarterly hard disk shipments reached 160 million ~1.7 billion, can store 100 bytes (PB). Of course, this is not enough.
(Responsible editor: The good of the Legacy)