Hadoop is a development tool for large data development needs

The value contained in large data has been a driving force for the developers of Hadoop and related tools to motivate themselves when they encounter difficulties. A survey by a large data and service provider, Wikibon, says many companies ' technicians often lack training to effectively use complex hadoop.

Jonathan Gray, founder and CEO of Continnuity, said the training was not designed to produce many Hadoop experts, and that companies should focus on developing better tools to help developers develop large data software.

The Continnuity company began building a software development platform based on Hadoop 2 years ago. The company, located in Palo Alto, Calif., currently employs 30 people, two-thirds of whom are engineers.

"We are a company focused on Hadoop, but our difference is that we are more concerned about developers," says Gray. Gray told reporters: "We have built middleware on Hadoop and an application server." ”

Before Continuuity Nitin Motgi, the predecessor of Yahoo, in 2011, Gray was a Facebook software engineer who was early adopters of the company's HBase project with Hadoop. Their task is to make it easier for developers to build Hadoop and manage applications.

In Gray's view, many companies today-especially telecoms, financial services, retailing and insurance-are swimming in the data, and they don't know how to profit from it. These companies are often the early adopters of Hadoop and the most likely to benefit from large data software. "So what do we do," Gray added, "We're going to authorize 10,000 developers to the bank, but only 3 of those developers are Hadoop developers, and we use these for development." ”

You will find that a large number of people do not need to have a rich knowledge of Hadoop, and do not need to train into a mature data expert. Instead, what we need is a powerful tool for developing large data software. This is the Continuuity company hopes to open up a market. "We separate the data experts from the developers, which are two different people, many of whom have a bit too much emphasis on the scientific part of the equation, not enough on the developer." ”

In our lives you will see that the constant innovation of hardware devices, like wearable devices, smart cars, smart homes, is what software data drives. "They have geographic data, demographic data, web browsing data," says Gray, a telecoms firm that has a large user data position. It can be said that they have a "ton" of data. But interestingly, these companies are asking, "How do we turn this pile of data into dollars?"

Competition in large data areas is fierce, with a large number of VCs throwing money at Hadoop companies. "What distinguishes us from other Hadoop companies is the focus on developers and our large data applications," Gray stressed. If you look at traditional suppliers like Cloudera and Hortonworks, they sell data warehouses and they sell bi analytics tools. ”

"Of course, the BI tool has its value, but you'll find that very few people focus on the data for products and services, which are all about apps, and most markets don't pay attention to that." This is also a challenge for us. ”

"However, we are confident because we believe that large data applications are correct." ”