Big data products are not just IT tools

For business personnel of enterprises, especially data scientists, intelliica's intelligent data platform is not only an intelligent big data preprocessing tool, but also brings direct value to enterprises like business systems.

Internet enterprises usually emphasize details and micro-innovation, so they can achieve the ultimate in a certain function of the product, so as to firmly attract a large number of users. However, enterprise-level vendors are different, and they tend to make their products more platform-based. The advantage of platformization is that you can integrate as many functions as possible to facilitate deployment and management, and shield the complexity of the underlying architecture from the platform. Particularly, software vendors are platform-based. For example, data protection vendors have data protection and unified management platforms, and big data product manufacturers have big data processing platforms.

In May this year, the independent enterprise data integration software provider Informatica released Intelligent Data Platform on the annual Informatica world. As the next-generation data platform, intelligent data platform can provide correct data at the right time and lay a highway for virtual data, people, locations, and devices are closely linked in a more intelligent manner to provide better support for big data applications.

　Improve intelligence

Intelligent Data Platform contains three core components: first, Informatica vibe virtual data machine. Vibe is an embedded data processing engine that provides universal access to data from any location, format, or source. It also supports "one-time ing and multiple deployment". Second, data Infrastructure. The data infrastructure layer can deliver clean, secure, and interconnected data systematically and continuously in any scale environment, from department-level to enterprise-level, from transaction data to big data, data can be deployed from the cloud. Third, data intelligence. The unique data intelligence layer of Informatica will help customers locate the metadata created at the data infrastructure layer to improve data visibility, decision-making, and Operation intelligence.

Intelligent Data Platform can pass the correct data to the relevant personnel or to the correct location in the correct way. But Bin, chief product consultant for Informatica Greater China, summarized the main functions of Intelligent Data Platform: Informatica can provide the highest quality of correct data at the right time; Informatica can deliver data to the right place, informatica can deliver data to the right people, whether it staff, analysts, data administrators, or business users. Informatica can deliver data to the right devices, including networked devices or automated decision-making systems; Informatica can deliver data in the correct way and ensure data security, reliability, authorization, and protection.

Intelligent Data Platform was released at the Informatica World 2014 conference, which was widely welcomed by the participating Informatica users. Informatica presented a series of intelligent data platform application cases at the Conference, including self-service data integration (springbok project) and data-oriented Security Management ([email protected] project) and 360-degree comprehensive business entity (MDM 10. Currently, intelligent data platform has not been fully commercialized. The reason why intelligent data platform is released in advance in Informatica World 2014 is that Informatica wants to listen to user feedback before the product is officially released, and then further improve intelligent data platform based on user feedback, choose another commercially available version. It has become a practice for Informatica to develop new products before the product is officially released.

　　Serve data scientists

Some Insiders pointed out that big data has reached a new stage and it is out of date to solve the big data problem according to the traditional business intelligence (BI) ideas and methods. Traditional Bi adopts vertical data processing methods including data collection, storage, processing, analysis and presentation, while new big data processing and utilization methods are distributed and flat.

Traditional data processing methods are modeled, and vendors provide solutions as needed. However, these solutions are usually fixed and cannot be flexibly expanded. If a user puts forward new requirements, it will be very troublesome to add new functions or make modifications to the original system. Intelligent Data Platform can solve this problem, because it is an intelligent platform that can establish correlation for various types of data concentrated in the "data lake, then, it is provided to business applications or connected to analysis tools through interfaces.

Is traditional database and analysis technology still used in Big Data Processing? However, Bin believes that there is no right or wrong problem between traditional technologies and new technologies, but that appropriate technologies should be selected for different applications. For example, Common Business Behavior Analysis in banks can still use database technology, while some predictive big data mining projects must adopt new big data processing technologies to present the associations between data.

"The biggest change Intelligent Data Platform brings to users is the liberation of IT personnel. Originally, IT staff had to do both business and technology. In the future, we hope that IT personnel can focus on development and system integration. Business personnel can describe the business more clearly Based on Intelligent Data Platform and automatically generate some rules." But Bin Said.

The underlying technology supporting intelligent data platform is the vibe virtual data machine of Informatica, which is also the basic engine of all Informatica products. On top of this engine, Informatica can help customers with data integration and improve data quality. Intelligent Data Platform is an integrated platform. From the IT perspective, its implementation will certainly have some challenges, but it can indeed bring more value to the business of enterprises. "It staff can extract and store data and then submit data for analysis ." But Bin told reporters, "however, business personnel or data scientists of an enterprise can mark the quality of data and discover problems, and discover more valuable things from the data. Therefore, we hope that our business staff can use intelligent data platform to access and use data more, not just IT staff ."

While introducing intelligent data platform, Informatica also proposed the concept of "data lake. The so-called data lake stores data from different sources, but instead of simply aggregating unprocessed data together, it needs to be pre-processed, establishing relationships between data is more conducive to future big data processing.

650) This. width = 650; "src =" http://www.ciw.com.cn/Portals/52/14 (179).jpg "/>

　　Big Data is a Business System

Traditional data processing and analysis are the tasks of IT personnel. Therefore, IT personnel must master a wealth of mathematical knowledge and computer technology. However, the ultimate goal of big data is to serve enterprise businesses and applications, while it staff usually do not know much about the business, which leads to the gap between big data technology and applications. But Bin said that the ideal user of intelligent data platform is the company's business staff or data scientists. Because they are more familiar with business needs, they can use intelligent data platform to better interpret big data analysis results.

Is the big data processing system an IT tool or a business system? Different positioning determines the different "fate" of big data processing systems ". "Many Chinese customers generally use big data processing systems as an IT tool. From the it O & M perspective, IT personnel are only responsible for ensuring the normal operation and switch of the system. Although some code is occasionally written, after all, they cannot make full use of the Big Data Processing System from the business perspective. In this case, the big data processing system is only an IT support and assurance system, and cannot directly bring business value to enterprises ." But Bin Said, "if we treat big data processing systems as a business system, business personnel can use this platform to better mine data and bring direct value to the business ."

According to the reporter's understanding, a single function of big data products may require a few hundred thousand yuan, and the price of a comprehensive big data solution may reach 100,000 yuan. If the value of big data products cannot be fully utilized, it is a huge waste for enterprises. But Bin said: "If enterprises only use big data products as an IT tool, they may not continuously upgrade the product or purchase professional services from the manufacturer, once a problem cannot be solved, you may give up easily."

Informatica once took technical staff from a Chinese bank to the United States to communicate with customers of Informatica. But bin was surprised that all American customers involved in the communication were the company's business staff, all about how the business system was running. The Chinese customers involved in the communication are all technical personnel. They want to know how American enterprises build a big data system, but do not care about how the system runs and how it brings value to enterprises. Such a strong contrast reminds Chinese users: first, deploying big data applications should be business-oriented and start-up; second, it is best for enterprises to take the lead in deploying and applying big data systems on their own, because enterprises are the most familiar with their own business needs, they can make full use of the big data platform to improve the efficiency of data analysis.

This article from the "Guo Tao's storage world" blog, please be sure to keep this source http://gtstorageworld.blog.51cto.com/908359/1559615

Big data products are not just IT tools