At present, big data has become a hot topic in the world. Gartner ranked large data as the most important technical direction for CIOs in the 2012, and IDC believes that big data is one of the most significant aspects of the enterprise's capacity reserve. In the recently held Teradata Data Warehouse and Enterprise Analysis Summit, the industry's hot talk "Data gold", looking forward to the bright future of the big data age.
China Cloud reporter was fortunate to interview the Teradata company Chief Technical Officer Baoliming (Stephen BROBST), Teradata How to deal with the challenges of large data age, the current situation of large data development and the future development of direction lights.
Background information
Teradata is the world's leading data warehousing and integrated marketing management solutions provider, focused on data warehousing software, data warehousing platform and enterprise analysis, is the global enterprise-class data warehouse solutions leading vendors, is used in the world's largest commercial database of relational database management system, Committed to helping customers make smarter, more effective decision-making, giving enterprises the driving force of growing. December 2010, Teradata spent 525 million dollars to buy cloud computing software company Aprimo, further expand the cloud computing field, deal with IBM and Oracle and other large manufacturers competition; in March 2011, Teradata acquired the market leaders and pioneers of advanced analysis and management of various unstructured data aster Data BAE Inc. In less than half a year, Teradata with two acquisitions to rapidly expand its business scope, aiming at the current market is the hottest, most development prospects of the two areas-cloud computing and large data.
Two acquisitions in response to big data challenges
Reporter: Teradata company Why buy Aprimo, and the next technology hotspot-Consumer intelligence is there a connection?
Baoliming: Consumer intelligence can attract more consumers to make personal decisions like companies, we can provide more content to consumers through consumer intelligence, let consumers choose the products and services they need. Now the entire industry has undergone a transition from outward to inward, and this is also a very powerful aspect of Aprimo, which, in addition to acquiring Aprimo, has acquired other companies to help provide an inward market or consumer intelligence function.
In addition, Aprimo company in the analysis and integration of marketing Management is a leading provider of solutions, and Teradata Company in the activities of the management also has a very strong ability, so this acquisition is a powerful union, consolidating the Teradata Company's market position, The further reason is that Aprimo has a very strong ability in software as well as services. After the acquisition of Aprimo, you can teradata all the application of the company in Aprimo software that is the service platform, to a greater degree to optimize the company's ability to teradata days.
Reporter: Teradata days of the company is an enterprise-class data Warehouse manufacturers, now for the consumer market, and the other Aprimo integrated marketing software is in fact for the consumer or with a more front-end some of the customer-related, this is not mean Teradata The company has some new strategic direction, What are the changes in the development of the company in the future?
Baoliming: I think this is an evolution and expansion of the company strategy, Teradata Company has been providing customers with Dynamic Data Warehouse solutions, now more to see the entire value chain of all relevant personnel.
An enterprise's value chain includes employees, customers, and these customers may be strategic suppliers of the enterprise. For example, companies such as Wal-Mart will have a number of strategic suppliers, including the consumer goods companies such as Procter and Gamble or Unilever, and Wal-Mart employees will need the relevant information or data from these suppliers, so consumer intelligence should be a major concept in the future. Consumers may access some Web site information and data that employees of a company will use.
Consumer intelligence is more of an extension of the entire enterprise Data Warehouse, hoping to make the intelligence for all people or more people to use, and Aprimo data analysis in integrated marketing management will be fully applied. There may be some different places in terms of strategy, the biggest difference being that consumer intelligence or Aprimo has the strong ability of data analysis in integrated marketing management, which is different from the data discovery platform that ASTER data company has. The Aster data Company has a powerful discovery platform, a platform that is used by scientists.
Reporter: Teradata days of the future technology development of the focus is what, how to balance structured and unstructured data analysis?
Baoliming: Teradata Company is concerned about the common application of different technologies to help enterprise users and consumers make better decisions. In the past, Teradata platform data were relational traditional data, and after acquiring Aster data, we were able to deal with the non relational types. As for large data analysis capabilities, Aster has its own file system, some programming changes and systems and the original Teradata platform is completely different, it provides the expansion of data analysis capabilities, extended to other different types of non-relational data. In the future, we will devote more effort to the Aster data Company's file system construction and related analysis tools.
Teradata Company Research and Development Department will increase the input of the software, increase the graphics or text processing research and development efforts, in addition to the traditional technology, some new technology is also the focus of our research and development I think the most important point is not only we can do in the research and development of how much innovation, SQL MapReduce analysis tools such as this can speed up innovation and enable consultants or customers to use more analytical algorithms to address the problems and challenges they face.
Development work on the ground is more important than innovation or research in the laboratory.
Reporter: There are a lot of big data analysis companies in the market, Teradata Company acquisitions aster data, because of the fancy of Aster data in the technology and market, which unique advantages?
Baoliming: Now Big data is a very hot topic, and many companies claim to have the function or technology of big data analysis, but some of them may just be able to handle a lot of data, and Aster data Company has the ability to handle the structure of multiple structures, its file system can change the shape of the entire storage data, For example, you can put the data in a column, or put the data in a graph or some text.
The ability to change the file system is unique to the Aster data company, and is not available to other companies that are known to have large data analysis capabilities; In addition, Aster data has a very unique analysis tool called Sql-mapreduce, a programming analysis tool, Initially in the Google company has related applications. Sql-mapreduce is simpler and easier to use than Hadoop, and can be tied to its file system to achieve a higher efficiency than Hadoop. This is also a unique feature of Asterdata, its ability to analyze programming is far higher than the original SQL analysis capabilities, more simple and easy to use.
New technology is emerging, big data has become a trend of market development, we have compared with other companies in the process of acquisition, but we found that they are only able to handle a large number of data, but Aster data is different, it not only take into account the increase in the amount of information, the expansion of data, The ability to have a variety of data analysis, so that's why we're rejecting other companies by choosing Aster. Teradata has always had the ability to handle large amounts of data, and now needs to consider diversity data.
Reporter: Future teradata and Aster data development platform will separate?
Baoliming: Aster Data Company's mission is to be faster for large data analysis of technical innovation, Aster Data Company and Teradata Company in technology and research and development have a lot of mutual exchanges, Teradata Day Rui Company will be to Aster Data company to provide some technical support, Aster data has any technical innovation achievements will be given to Teradata to practice and application, but the research and development departments between the two companies are completely separate, the reason for the separation is to more quickly achieve some technical innovation, Aster Data needs to be able to do very fast research and development in large data analysis, such as the file system mentioned earlier or some text or graphics processing system, if the two companies to integrate research and development systems, will largely slow down the pace of innovation.
But two companies are highly interoperable and interoperable on platforms, meaning that Teradata can see some of the work done by Aster data, and vice versa. We can see this data synchronously throughout the ecosystem, which makes the analysis of the data very easy to use, an ecosystem that allows for strong interoperability between the two sides.
Reporter: If the customer needs to analyze the structured data, also need to analyze the unstructured data, does that mean to purchase Teradata and Aster data products separately?
Baoliming: There are two different technologies, separate technologies, but they are interoperable, Teradata has the ability to handle structured and unstructured data, and if you need the ability to do large data analysis you can go to the Aster company to buy, But if you need the traditional relational data analysis ability, you can also come to Teradata Company purchase. Both are integrated, if both need you can get two from us, can also be separated to obtain, that is, the Aster data can be obtained from the analytical ability of large numbers, from Teradata to obtain relational data analysis capabilities.
Reporter: Aster data is the advantage of sql-mapreduce this technology, but Chinese customers prefer open source software, so is it a contradiction?
Baoliming: There is indeed a gray area between the two, but it depends on how it is balanced. Two platforms have a lot of advantages in terms of efficiency and complexity, and sql-mapreduce analysis tools are based on the familiar SQL, so the time to produce value should be faster. and Hadoop needs to write a program to get the final data analysis value, so it's a little bit slower than sql-mapreduce, where businesses may lose some other development opportunities. But Hadoop is a free software that can be downloaded, so the cost will have an advantage, so the value of the time and cost of the enterprise need to make trade-offs.
Of course, sometimes the so-called free is not necessarily completely free, for example, when you want to use Hadoop, the server you use may be 10 times times the server used by Sql-mapreduce, the software itself is free, but the server is not free, and the power and footprint of the server will cost you, as in the California area, You need to pay three years of electricity, you can send the server to you for free. Consider the question of total cost of ownership, not just the cost of the software license.
Previously, Teradata has been working to provide a relational database management system for enterprise-class databases, but with the development of things networking, mobile internet and cloud computing, unstructured data is exploding, and individual consumers are paying more attention to data, how the Nuggets are unstructured data, and the development of their own business to the personal consumer domain become Teradata need to solve the problem. Through the acquisition of Aprimo and Aster data, the two leading companies in the area of integrated marketing in the personal consumer market and in the field of unstructured analytics, Teradata not only a good solution to the problems faced, but also expand their own business scope for the future to occupy a greater market share has laid a good foundation.
The present situation and problems of China's "Big data" development
Reporter: At present, the big data is still in the concept of hot period, you think the business explosion in the long term when?
Baoliming: I think a lot of companies are already doing big data analysis in real sense, but in China maybe people are more likely to think of big data as a conceptual thing, and it's still in the exploratory phase. I've seen a lot of people in the last two weeks, and they've talked about the development of big data in China, and they're very interested in big data. Teradata Company hopes to be able to large-scale data analysis capabilities and technology into the Chinese market, and we have to seek some breakthroughs, so that the analysis of large data eventually become a mainstream technology.
For many customers, the technical or analytical ability to buy large data is a solution to the problem they face. In the past, it may be necessary to do some corresponding programming work to see the problem, now Aster data Company's Sql-mapreduce analysis tool can help customers solve the problem quickly, so many internet companies are willing to use. Some of these companies used to be very familiar with SQL tools, using SQL for data analysis, and now sql-mapreduce and SQL have a lot in common, and people who know SQL very easily when using Sql-mapreduce.
Reporter: China and the United States in many aspects of the development of the market environment are not the same, do you think the promotion of large data products business will encounter any difficulties?
Baoliming: The Chinese market is a very large market, a small bank in China may be the equivalent of the largest bank in the United States, which is a good opportunity for Teradata Company. Teradata has always been very concerned about the scalability of its solutions, which is an important reason to acquire Aster data, and the solution provided by Aster data is highly scalable. In addition, the Chinese market consumers are very sensitive to the price, people need to deal with massive data-large data technology, but do not want to spend too much money, in the Chinese market, people analyze each byte of data is willing to spend much less than in the United States people would like to spend for each byte of the price So if we have strong data compression capability, it can bring great benefits in economy.
Aster data also introduces a strong compression capability, which is a good choice for economics. Also in the Chinese market people prefer to use free software, or open source software, such as Hadoop, some analysis tools have the ability to open source, which is very much in line with the needs of the Chinese market. Aster data and Teradata will also invest more in the provision of open source tools or analytics and solutions, which is important for bringing large data solutions into China.
The difference between Chinese and American markets is that the issues to be addressed are different, in the U.S. market more to solve the optimization problem, because the U.S. market is a mature market, the introduction of solutions to help these customers save more money or create more profits, but the Chinese market to solve the problem of growth, how to get more customers, How to use existing customers to create more revenue.
The development of cloud computing provides a very favorable foundation and necessary tool for the big nuggets data. The "large-scale" characteristics of the Chinese market have also brought forward the development demand for large data analysis technology, at the same time, domestic and foreign enterprises have seen the great potential of the Chinese market in the field of large data analysis, and have been seizing the market opportunities through various ways. However, because the Chinese market consumers have their own characteristics, many foreign enterprises in the short term can not fully insight into these characteristics, or even see these characteristics, will not be rapid "local conditions", which provides a very favorable domestic manufacturers to seize the opportunity to market opportunities.
(Responsible editor: The good of the Legacy)