Big data will have a big development

So far, there's not a universally accepted definition of big data, which means that the big data you're talking about may not be the same thing as the big data that I'm talking about, but that doesn't prevent big data applications from becoming a recognized trend. According to the IDC report, in the next four years big data market growth, in the meantime the online data information will explode growth. According to IDC forecasts, 2017 large data technology and services market composite annual growth rate (CAGR) is expected to be 27%, the market size of 324 U.S. dollars (see: 2017 Large data market value of 32.4 billion U.S. dollars), the increase in ICT (information and communication technology) market 6 times times. Among them, the IDC Asia-Pacific (excluding Japan) large data market will increase from 548 million U.S. dollars in 2012 to 2.38 billion U.S. dollars in 2017, the annual composite growth rate reached 34.1%, exceeding the global average growth (see: 2017 Large data technology and services market size of 2.38 billion U.S. dollars). All indications are that the big data age is coming to us.

Large data technology and service driving force

Big data becomes a trend that means huge market business opportunities. Large data features can be summed up in large amounts of data (Volume), variety of data (produced), high Real-time (Velocity) and large commercial value (value), or 4 v. These 4 v also provide new requirements for data processing and storage.

In response to the new challenges of large data technology and services, many manufacturers have launched a large data integration platform, such as IBM's Netezza, Oracle Exadata All-in-one, EMC Greenplum, the wave of clouds large data machine and the dawn of the XData large data integration machine. Most of these large data integration machine with Hadoop as the management platform, for the mass of unstructured data distribution storage and management, the realization of the data distributed storage and localization of the nearest processing, with lateral flexibility to expand the function and characteristics. To increase the relevance of applications, these platform vendors work with application software solutions to provide users with large data applications as a whole solution.

Software system vendors are also active players in large data applications. Data analysis and mining are the strengths of traditional database vendors, data warehouses, and BI vendors. In the past, its application is mainly aimed at structured data, and the massive unstructured and semi-structured data are not suitable for traditional methods because of their low value density. However, with the decrease of hardware cost such as computing, storage and so on, especially the mature of distributed data storage and processing technology such as Hadoop and NFS, it is possible to make large data processing by means of map/reduce. In this case, whether it is IBM, Oracle, SAP and other database vendors, or Teradata, Informatica and other data warehouse vendors, or traditional BI vendors, such as SAS, are needles.

Provide targeted technologies and programs for large data applications. Based on the understanding of natural meaning, for data screening, extraction and aggregation, this is the advantage of these vendors, for large data application requirements have no more problems

In addition to the traditional hardware and software products suppliers, to Splunk, Ictclas as the representative of domestic and foreign large data application software manufacturers and technologies, but also provides a landing solution. In addition, the Apache Drill, Storm and other open source tools, MySQL, hlive, such as open source database in the Internet industry widely used.

Data opening is the key

Full data analysis is the key to the widespread popularity of large data applications. Experts pointed out that the data is not afraid of many, even if the wrong data, the more data the better, through large data analysis, there will be some unexpected effect.

Large data studies not only the data itself, but also the relationship between the data. Internet industry in the large data applications in the leading position, regardless of ad receptacle, ad Exchange, DSP, SSP, RTB, DMP and other advertising precision delivery, or consumer behavior analysis, product recommendations, Internet finance, etc. are based on large data analysis, So in the Internet industry, large data applications are already not a concept, but a landing project and business model.

Large data applications are also driven by the Internet industry, extending like a wider field. With the internet as a model, large data applications can help traditional industries/enterprises improve service and enhance market competitiveness. Large data applications emphasize results, and sometimes you may not know why, but big data will tell you the results and conclusions. Some of the vexed questions can be obtained by large data analysis. For example, through data analysis of smoking and cancer incidence, scientists found that smoking did not lead to a significant increase in the incidence of cancer. This is a result, and its scientific reasons have yet to be studied and excavated.

The accuracy of large data analysis results depends on the integrity of the data. The traditional industry has accumulated a lot of data for many years and is also the holder of data. But overall, a certain enterprise or industry is only part of the data holders, in order to maximize the value of data, data opening is the inevitable road. In his quest for re-election, Mr Obama has made the promotion of government-sector data open an objective strategy.

It can be foreseen that the maturity of large data hardware and software technology, data sharing and opening will become a very urgent problem, in the Open data, how to achieve the reasonable use of data, while protecting the privacy of data, will become a new topic of large data development, the need for relevant legal systems. Data openness will be a catalyst for large data applications, and may also be a stumbling block to the application of large data.

Experts pointed out that in today's environmental conditions, the industry/enterprise on the one hand to strengthen the social data, such as the Internet, smart Community data utilization, on the other hand, the industry/enterprise should be as far as possible to achieve the digital management, especially for email, instant messaging software and other data management and protection, Large data application requirements will greatly enhance the industry/enterprise data management and protection awareness, which will be intangible wealth, but also maintain the industry/enterprise competitiveness of the data base.