Large Data survey: The current situation of enterprise using large data

The hype surrounding big data is crazy, and the hype is driving a lot of investment into the field.

IDC, a market-research firm, predicts that the big data technology and services market will grow at an annual rate of 27% per cent to $32.4 billion by 2017. This growth in the big data market is more than 6 times times higher than the overall ICT market, IDC said.

But despite the abundance of money, it is unclear whether the business community has found a way to succeed after the early adoption of big data. To find a clear answer, the researchers surveyed the IT managers and managers of many companies, who shared their large data plans, investments and key details.

Implemented by receptacle world, the 2014 Large Data survey (CIO, Computerworld, CSO, InfoWorld, and ITWorld), a group of the five largest companies in IDG, has found some key points.

The survey involved companies in various stages of large data deployments. Some enterprises have implemented (19%) or are implementing (25%) large data projects. Other companies have developed implementation plans that will be implemented in the next 12 months (16%) or the next 13-24 months (16%). The remaining companies (23%) are unsure that they may implement large data projects at some point in the future, but are still struggling to find the right strategy or solution.

From a macro point of view, large data is becoming more and more important for companies of all sizes in all industries. When asked how important the big Data program was to companies, 53% of respondents responded to critical or high priority, while another 34% per cent of respondents responded to moderate priorities. Only 12% per cent of respondents considered large data programmes to be low priority projects.

Here are some other key points found in this survey:

1, the Enterprise wants the decision-making to be more accurate, is quicker.

Why use large data? Because it plays a vital role in the quality and speed of corporate decision-making. The two most common business goals that drive companies to invest in big data are improving the quality of decisions (59%) and increasing decision-making speed (53%).

The next big data business goal is to improve planning and forecasting (47%), to develop new products/services and revenue streams (47%), to attract new customer/customer retention rates (44%), and to establish new business partnerships (34%).

2, more and more large enterprises are entering the PB era.

The enterprise has accumulated huge datasets associated with its customers and businesses. Of all surveyed enterprises, the average amount of data currently managed is 164TB. When asked about the amount of data they would expect to manage in the next three to 12-18 months, respondents predicted an average 289tb--growth rate of 76%!

Today, 6% per cent of companies surveyed are already managing more than 1PB of data, which will increase to 14% over the next 12-18 months. In the largest companies (those earning at least $1 billion trillion), 31% are expected to manage more than 1PB of data.

3, the enterprise has felt the consequences of data overload.

When there is a huge amount of data pouring into the enterprise, there will inevitably be many consequences. such as inability or inability to quickly find the information needed to lose some business (11% of respondents think this is a frequent occurrence, 31% consider accidental occurrence); delays occur in making important decisions (14% often, 39% by chance); users are overwhelmed by data (19% often, 46% Occurrence of a data security problem (4% occurs frequently, 15% occurs accidentally).

4, the Enterprise prepares the investment; ROI is not a major obstacle now.

The survey found that a limited budget is the most pressing big Data challenge. In the surveyed companies, there is very little investment. In the low-end market, 19% of respondents said they spent less than 100,000 dollars on big data in the coming year. In the high-end market, 29% of companies say they will invest more than 1 million dollars (2% of them say they will spend 100 million dollars or more).

These investments will be spent on a wide range of different data-related areas, including:

Develop or purchase software applications (38%)

Invest in additional server or storage hardware and software (37%)

Using open source software frameworks (such as Apache Hadoop) (30%)

Cloud storage Service Migration (28%)

Increase network bandwidth (27%)

Cloud Analysis Service Migration (26%)

But while large data budgets are the most common concern, ROI is not a pressing issue. Only 26% per cent of respondents considered the ROI of the investment to be the main obstacle.

5, enterprises feel a large shortage of data talent.

Companies are concerned about finding the right people they need--such as knowledge workers, data scientists--to implement most of the big data plans of the enterprise. In terms of staff, 34% of companies are recruiting talent with analytical skills, and 26% are considering outsourcing large data specialists.

When asked about the skills that the company plans to employ in the next 12-18 months, data scientists dominate (27%), followed by data architects (24%), data Analysts (24%), Data visualization specialists (23%), business Analyst (21%), research Analyst (21%) , Director analyst or analyst Manager (19%), and database Programmer (19%).

6, the data security problem, but not the most urgent problems.

Limited budgets and a shortage of talent are two of the most pressing data challenges. In addition, the respondents listed security issues (35%), Development time (35%), legacy issues such as integration of existing tools (33%), poor data quality (32%), and difficulties in consolidating or analyzing real-time data (30%).

On the topic of security, nearly half of the respondents (49%) indicate that their existing security solutions and products have been able to provide the right large data security. 29% of respondents said existing solutions and products did not apply to big data, and 22% said they did not know.

7, what is more difficult: business integration or cultural adoption?

When asked whether the respondents were challenging to integrate large data plans into the organization's business processes and culture, the response was challenging or challenging, and cultural integration (54%) was slightly ahead of business process integration (50%) with a slim majority.

8. The IT department dominates the large data plan, but success depends on cross-functional cooperation.

It's leading big data projects are the norm in the respondents: 46% of respondents said senior IT managers dominate their big data projects. But it executives are not doing it alone: 36% of companies say business leaders are also involved. In addition, respondents said their large data projects were supported by CEOs (47% per cent) or LOB support (34%). It leaders and business leaders agree that large data projects are likely to achieve the best possible success when both sides collaborate on specific business challenges.

9, for many enterprises, the momentum of development will continue.

Looking to the future, nearly half of the respondents (48%) believe that the use of large data in the next three years will be widely launched within the enterprise, and another 26% of the companies believe that large data in one or more business units to become mainstream applications. Only 5% of respondents said big data plans would disappear with speculation, and another 5% said they didn't know. The remaining 16% of the companies are expected to try large data, but will not be used in mainstream production. (Wave Compilation)

(Responsible editor: The good of the Legacy)