Demand for big data technologies and services is on the rise across the world today and significant growth has been observed at all levels of the big data technology stack. Storage is an important part of the infrastructure components and will maintain a CAGR of 53% from 2011 to 2016 (referred to as CAGR). International Data Corporation (IDC) presented its first set of tests for big data and analytics storage in just two published in depth research reports: Big Data Storage: Usage Depth Analysis and Implications in Big Data Storage Deployments Architecture findings.
The amount of data generated, processed and stored by most businesses will continue to grow in the foreseeable future. "Storage will be one of the most important components of the infrastructure to provide a platform for big data and analytics environments for predictive purposes," said Ashish Nadkarni, director of storage systems research at IDC. "The storage requirements brought by big data and analytics environments will generate huge profit margins and their total market will increase from $ 379.9 million in 2011 to nearly $ 6 billion in 2016. This growth is due in large part to capacity Optimized systems, including high-density enclosures, but software-based, distributed storage systems with internal disks will also be the ideal solution for the processed data and are ideal for some users. "
In addition, companies will continue to march toward new data sources, which is closely linked with analysts shifting big data from research to exploration. This shift will make the infrastructure investment further increased, and the construction of the data structure platform will also be significantly promoted.
Big Data Storage: Using Model Profiling
IDC's research report evaluates IDC's Big Data survey of storage trends in the first quarter of 2013. Storage, as an extremely important subsystem, can become an important criterion for judging the success of big data and analytic examples. Capacity improvements and application performance improvements will continue to be the biggest challenge for organizations of all sizes in the storage space that interfaces with big data and analytics environments.
68.6% of respondents regard performance as the main reference for choosing a storage architecture. In addition, 59.5% of respondents considered the implementation cost as the main driver of the choice (the survey allows multiple options).
Less than 31% of respondents said they have not deployed an enterprise storage system for data analytics infrastructures, but said they also have plans to embark on a plan within the next six months.
The two major branches of the big data infrastructure are evenly matched in terms of supported ratios, with 30.1% supportive for converged infrastructures and 29.4% for discrete ones. In addition, 28.4% of respondents chose to integrate internal Resources.
"The Impact of Big Data Storage Deployment"
In this research note, IDC explores some of the organizational determinations and "behind-the-scenes" challenges organizations face in the area of big data infrastructures - which may emerge during or after deployment. Businesses will continue their efforts to assess what data needs to be analyzed, how to save the data before and after the analysis, and how to feed the data analysis conclusions back into the business process.
63.7% of respondents considered handling operational-related data as a prime use case for deploying data analytics infrastructures, while 53.3% considered transactional data from sales or retail end systems as their top priority.
The IT department is currently the largest contributor to the data analytics infrastructures, with operations in second place.
Based on the opinion of just over 61% of respondents, improving customer satisfaction is the biggest business challenge in data analytics deployment.