2013 forecast: The five big challenges of big data

"IT168 Review" John Bantleman is the CEO of Rainstor, with more than 20 years of experience. He published an article in Wired. Pro data will be one of the most important issues for businesses in the 2013 and 5 predictions of the challenges of this year's big data.

The following is the full text of the article:

2012, Big data has proven to be an important trend, and a lot of forecasts for the big data market for the coming year. The reality is that customers will ultimately determine the trends in large data and decide which technical solutions to use to address their unique business problems.

In today's data-driven world, large data has become a must for companies to remain competitive. Like cloud computing's ups and downs over the past few years, it has now begun to push companies to change their infrastructure to cope with complex challenges. According to a recent study, the number of large data is expected to increase by about 60% in 2013, a problem that is not expected to disappear soon.

So it should be seen that in 2013 years companies will face the commercial or technical challenges of big data. One thing we can be sure of--in 2013, whether it's big data technology changes or corporate board decisions on the industry, will change.

Forecast 1: Enterprise large data initiative from sandbox, and define a set of clear business and technical requirements

In the 2012, companies ' proactive upgrades over big data exceeded most people's predictions. According to a study of 300 large companies around the world, the volume of data is expected to increase by about 60% in 2013. 13% of respondents said they were ready for big data. Another 38% of companies have plans to implement them.

Companies are forming specialized large data teams, and for many it has become a series of projects, as companies need to continue to look for better ways to manage, store, and analyze the data assets that are constantly growing and that must be kept online for analysis. We will see more clearly defined requirements beginning to occur-whether in terms of business or it, such as low-cost scalability, fast response queries and analytics, and the ability to make the most of existing standards-based tools, including SQL and BI. This is the functionality that the enterprise expects to appear in addition to the built-in security and data availability features.

Forecast 2: Companies looking to manage large data will seek new technology combinations other than Hadoop

Over the past year, Hadoop has been gaining momentum. The promotion of Hadoop through the Web 2.0 organization is now being valued by banks, financial institutions, telecom operators, large retailers and other businesses. However, large data initiatives focus not only on the Hadoop platform.

The challenge for business and it is to combine different technical coordination efforts across different departments and even across different companies. Companies deploy private clouds to manage the combination of data assets with traditional database and data warehouse environments, and the Hadoop infrastructure that runs on a variety of hardware. A common theme for all large enterprise data projects is the desire to be able to quickly start and run without causing disruption to the existing IT environment.

Forecast 3: Budget constraints are one of the biggest hurdles to tackling big data challenges

Spending on big data is rising, and in the coming year, the cost problem will remain one of the biggest hurdles to launching big data projects. According to a recent analysis, large data expenditures are expected to reach $34 billion trillion in 2013. These expenditures are due to the fact that some special industry organizations have to maintain data online and availability because of the industry's specificity, on the other hand, companies want to use more information from multiple sources for better analysis. This requires an appropriate balance-the challenge of finding the most efficient technology infrastructure while meeting business needs.

The growth of large data will not slow down. Building capacity for existing and future needs is critical. Too much too fast is not the way to go, big data does not necessarily mean a large budget.

Forecast 4: Large data tools must meet both business and technical users

In 2013, we will see a growing demand for large data tools and applications that will become easier to use and will meet both business and technology users. If you delve into the basics of Hadoop, you will see that it is still immature in many ways and requires unique expertise. We have seen many new products to address this demand, including Cloudera Impala and Microsoft Polybase. In fact, some of the features that already exist today make it easier to access the right data at the right time with the best toolset.

Forecast 5: Heavyweight manufacturers, such as Oracle and IBM, will acquire large data markets

Over the past year, large organizations have embraced big data as large data markets have matured. We anticipate that some vendors who lack unique technical capabilities or expertise will be acquired in 2013. Two obvious heavyweight manufacturers are Oracle and IBM, which have built a variety of products in the field of data management. But more should see, the product goes on the market time is the key which the enterprise obtains the stronger foothold.

Big data in the spotlight

As the growing need to use large data to expand its competitive edge, and the rise of innovative products, companies will change the storage, management and analysis of their most important assets-data. Enables organizations to find a more efficient and cost-effective way to manage a petabyte data environment. In the next 12 months, data management will be the focus of attention because it is a problem for every company.