San Jose Hadoop Summit 2014 points

In the era of data-king, the ability of data mining has become one of the important indexes to measure the competitiveness of enterprises. How to make use of the common large data platform Hadoop, how to choose a suitable enterprise business of the Hadoop distribution has undoubtedly become the enterprise's necessary skills. In this costly exploration process, the top events in the large data industry have undoubtedly become an important cognitive and learning channel for each institution. Here we go into Hadoop Summit 2014.

The 2014 Hadoop summit, held in San Jose, USA, from June 3 to 5th, brought together Hortonworks, Cloudera, MAPR, Gartner, Microsoft, At&t, Teradata, Red Hat, Yahoo!, Many well-known organizations, such as SAP, have described the entire Hadoop biosphere around large data processing from a technical and practical perspective.

Hadoop Market Trends

Allied Harsh research report shows that 2013 to 2020, the global market share of Hadoop will be 58.2% of the composite annual growth rate, from 2 billion U.S. dollars to 50.2 billion U.S. dollars, the growth rate of more than 25 times times. The large data analysis demand is the main driving force of the whole Hadoop market, and attracts many it gold miners to participate. Throughout this Hadoop summit, I counted 3 representative events, here to share.

1. It traditional giants and nouveau riche union, Hadoop Ecological Circle Beacon reburning

Microsoft SQL Server Marketing General Manager Eron Kelly and Hortonworks strategic marketing vice President John Kreisa announced Microsoft's partnership with Hortonworks, And said Microsoft will work with Hortonworks to create user-familiar Hadoop data processing tools.

In the process of evolving data solutions, Kelly said, Microsoft has been pursuing data access with Windows tools designed to reduce proprietary features in the solution. Between proprietary and Hadoop, Microsoft chose Hadoop and worked with Hortonworks.

Kreisa also agrees with Microsoft's vision of using Excel to handle large data, and is willing to work with Microsoft to bring Hadoop technology into the mainstream IT market.

2. The traditional industry stops, the Hadoop biosphere ecosystem vigor multiplication

During the Hadoop summit, Hortonworks hosted an analyst meeting to listen to their practical experience, and at the meeting, it was surprising that some veteran companies had embraced Hadoop.

Airways gas is a 250-Year-old veteran company that is installing smart meters for millions of homes

TrueCar is also actively embracing Hadoop, although they do not have any experience with Hadoop and traditional

Instead of technology, Sprint's Hadoop tour began with business and analysts, who together were responsible for gathering large amounts of data to identify possible art

Shaun Connelly, vice president of Hortonworks strategy, points out that the times are changing and the market has changed, and that many years ago you wouldn't have thought that companies like IBM, CISC and Sprint would sign up to support open source platforms. The real value of Hadoop lies in practice and as a tool to drive change in the business itself, like guessing from a vision described by a friend from Airways gas, you can't possibly think of it as a fuel company.

3. A recruit fresh, eat the day, Actian interpretation of the meaning of fast

"Maturity is not the first concern of SQL," says Peter Boncz, a Actian company consultant and senior research scientist at the University of Amsterdam. "The idea of adding sql/hadoop solutions as a component to a traditional database system doesn't always take into account the specific requirements of analytical workloads, And vortex just make up for this, it is not only the original component of Hadoop infrastructure, in far more than the current system speed, the shunt update mechanism to avoid the system update on the bottom HDFs.

The evolution of Hadoop biosphere

As Hortonworks strategic vice President Shaun said, the times are changing, the market changes in the business needs of the stimulus, the Hadoop ecosystem is also constantly evolving, where we mainly from the Hadoop Summit 2014 conference to show the 3 major changes to start.

1. From technology to application to eliminate the dependence of specific types of talents

After several years of development, major solution providers have begun to focus on the use of non-technical experience and the effectiveness of mining data. Now that data scientists need to spend more than 80% of their working hours on error filtering, resolution consistency, and compatibility processing, Pentaho says, many solution providers are starting to focus on this point, such as Pentaho and talent.

In addition to further improve the productivity of the platform, eliminating technical solutions to specific types of talent is a high degree of dependence is also one of the problems to be solved, and Actian and Altoscale is committed to this two companies. The former is committed to reducing the proportion of data scientists in the process of extracting value, while the latter is committed to the difficulty of using the platform of non-technical personnel.

2. Security challenges, data transfer across the datacenter

The development of Hadoop has been hampered by many factors such as monetization, multiple competitors, technology gap and security, and data security is undoubtedly the most important part. To provide a secure data-transfer environment, companies are racking their brains--hortonworks acquisition of secure start-up Xa secure,cloudera capture Gazzang.

WANdisco CTO Jagane Sundar pointed out that as the organization to build more data centers, data transmission across the datacenter has become an inevitable trend, in the High availability assurance, the various agencies also need to ensure the security of user data, WANdisco through the single HDFs and single point authentication solution.

3. Achievement is king, Agile, user experience is essential

Oliver Ratzesberger, senior vice president of software business at Teradata, says companies need to master the real needs of new markets and new customers, and that all efforts are futile if they do not truly derive value from data and analysis. He believes that in the process of value extraction, agile is the most important, if not in the shortest possible time to get practical, effective information, the platform will be discarded by users. Asked about the agile infrastructure, Oliver said the CIO was an agile initiator, CMO,CEO, and even board decisions were crucial.

Top impact: Hortonworks vs. Cloudera

At the meeting, WANdisco CTO Jagane pointed out that although Cloudera and Hortonworks are the two most powerful players in the market, the focus is destined to have two of the biggest winners in the field. Cloudera more concerned about the enterprise itself, and hortonworks more attention to open source. At the same time, the popular distribution is definitely more than the two companies, and the innovation of hundreds of companies will undoubtedly make the Hadoop biosphere more prosperous.

However, the situation is not the case in the mature market and the fierce competition in the present. On Hadoop summit, Cloudera's acquisition of a business focused on the Hadoop security business Gazzang is undoubtedly a Sando Mamang strategy.

Wikibon analyst Jeff Kelly points out that two acquisitions point to the focus of the Hadoop business, as well as the satisfaction of enterprise-class requirements. Once Hadoop is running in a sensitive data environment, any security effort may be the key to success, and they are only doing so to counteract the advantage.

Kelly also said that while there are 50.2 billion of dollars in the future market, but the new big data market is also extremely brutal, two companies will eventually end up with the acquisition or acquisition. And in this process, the two sides hold the funds, and the cooperation of various fields giants will influence the development of the results.

Written in the last

In this many gold market, each solution provider is "eight, recount", the white-hot competition does depict an exciting positive trend, but if this market can accommodate a number of giants, then more attention to market demand and user experience, the future seems more desirable.