Large data growth poses new challenges for data storage systems

"The role of data storage is changing, one of the factors is that data is becoming more and more complex, and for a data storage system designed 5-10 years ago, it must be able to handle the diversity of resources," said Donald Feinberg, the analyst's Vice president Complexity, large capacity, and system response speed to real-time and other characteristics. And he argues that while big data has different meanings for different industries, basically large data represents large, complex, unstructured data.

However, it is difficult to deal with large data for relational database management systems that are good at dealing with structured data. As a result, Donald Feinberg says most companies currently create a space or platform to store unstructured data or large data.

With the advent of large data, Donald Feinberg says the concept of future logical data storage will emerge, that is, storing different types of data in different databases, using the right tools to get the correct resources, The logical data store uses the appropriate backend data to link the different data in all the data storage systems.

Donald Feinberg also says that there are many tools used to handle huge amounts of unstructured data, but there will be many applications that are developed using mapreduce technology.

Data storage vendors face the challenge of responding to queries quickly

Large data impact level, IDC software market analyst Mr Tsui Ling said big data for all vendors are new battlefield, including storage vendors, such as EMC bought data storage software industry Greenplum is one example. The reason is that, she believes, data storage is really the main force to apply large data.

However, there are still many challenges for data storage vendors, and the first is that they must strengthen the effectiveness of relational databases and increase the functionality of data management and data compression.

Because of the past, the relational database products processing a large number of data is not fast, the need to introduce new technologies to speed up the function of data query. In addition, the data store manufacturers are also beginning to try not only to use traditional hard disk to store data, such as the use of Fast flash memory database, flash database, etc., are gradually generated.

Another challenge is that the traditional relational database can not analyze unstructured data, therefore, mergers and acquisitions have the analysis of unstructured data manufacturers and data management vendors, is the current data storage manufacturers to expand the direction of power.

The impact of data management is primarily the consideration of data security. Wunai, IDC software market analyst, says large data can also have an impact on storage technology and resource security. First of all, snapshots, data deduplication and other technologies are important in the large data age, which derives the management of data rights.

For example, now the enterprise backend and the front end of the data pattern is not the same, when the enterprise to deal with unstructured data, it is necessary to work out whether IT department or business unit is the data manager. And Wunai said, because this involves not only technical issues, but also the formulation of corporate policy, so the definition of data managers is the most headache of the enterprise.

(Responsible editor: Lu Guang)