Big Data hits Informatica to answer good ideas

What is big data?

We live in an information explosion era, we receive a variety of messages every day: SMS, mail, telephone ..., we also produce a variety of information every day: microblogging, blog, Frid ... All kinds of information are filled with the world, how should we deal with and make use of such a large amount of information? The challenges posed by these problems have brought the industry to an unprecedented level of enthusiasm for "big data". Not long ago, the reporter participated in the leading enterprise data integration software Independent supplier Informatica Company to hold the seminar, with Informatica China Region chief product consultant But Mr.

Informatica China Chief Product Advisor but bin

What is big data?

Although "Big Data" can be translated into large or massive data, there is a difference between large data and massive data. Informatica, chief product advisor in China but Bin said: "Big Data" contains the meaning of "massive data", and in the content beyond the mass of data, in short, "Big Data" is "mass data" + Complex type of data.

Large data sets, including transactions and interactive datasets, are larger or more complex than the ability of common technologies to capture, manage, and process these datasets at reasonable cost and time. The big data is made up of three key technology trends:

Massive transaction data: Traditional relational data as well as unstructured and semi-structured information continue to grow in online transaction processing (OLTP) and analysis systems from ERP applications to data warehousing applications. This situation becomes more complex as businesses move more data and business processes to public and private clouds.

Massive Interactive data: the forces of the Force are made up of social media data from Facebook, Twitter, LinkedIn and other sources. It includes call detail records (CDR), device and sensor information, GPS and geo-location mapping data, mass image files transmitted through the managed file transfer (Manage file transmits) protocol, Web text and click Stream data, scientific information, e-mail, and so on.

Massive data processing: the emergence of large numbers has spawned architectures designed for data-intensive processing, such as Apache Hadoop, which has open source and runs in the commodity hardware cluster. The challenge for businesses is to quickly and reliably access data from Hadoop in a cost-effective way.

Specific to a business/organization, there is no explicit size definition for large data, although the number is usually between dozens of bytes and multiple bytes. A survey of 531 independent Oracle users by Unisphere Research found that 90% of businesses are rapidly rising, with 16% per cent growing at 50% or higher annually.

Many companies have felt the impact of runaway data growth on performance. A Informatica-sponsored Unisphere Research survey found that 87% of respondents blamed the company's application performance problems on growing volumes of data.

(Responsible editor: The good of the Legacy)