The job market is harsh Hadoop scenery here is excellent

Analysts and IT managers at Hadoop World told how important Hadoop is for the business. According to Kobielus, an analyst at Forrester Research, "Hadoop is a new type of data warehouse and a new source of data within the organization." Hadoop's advantage over traditional relational databases is its ability to store and manage more structured and unstructured data.

In today's big data era, enterprises need to pay more attention to the storage and analysis of data in order to develop their customers and improve their business. The data come from various aspects such as Weibo, website clickthrough rate and social media content. One of the immediate questions is who will analyze the data? How to analyze the data? Obviously, those professionals with advanced data analysis skills are needed. Specifically, their capabilities should include: data analysis, data mining, Predictive modeling, natural language processing, content analysis, text analysis and social networking analytics. For Hadoop, they also must learn to use MapReduce to predict and model statistics. Not only that, but for Hadoop platform managers they must be able to handle Hadoop clustering, security management, and performance optimization. Kobielus also noted that "DBAs at Teradata and Oracle Exadata are also beginning to migrate to Hadoop cluster administrators, recognizing that this is a completely new area." Of course, these professionals also associate existing relational databases Strategy to Hadoop platform.

A sales executive with Hadoop-related software said: "There are currently three categories of requirements for Hadoop professionals: data analysts / data scientists, data engineers, and IT data management professionals."

The first is Hadoop data analysts who know how to choose, install, and manage Hadoop clusters. They will decide whether to deploy Cloud Hadoop, which Hadoop vendors to choose from, how to allocate Hadoop resources, configure the cluster, and how to debug and run Hadoop applications. At this point, compared with the traditional relational database and data warehouse data analysts, can be described as much the same.

The second category is Hadoop data engineers, they are mainly responsible for data processing, MapReduce algorithm. As business Hadoop applications grow, those who have Java, C + + programming experience will find more jobs.

The third category is Hadoop data stewards, who typically have specialized data scientists in SAS and SPSS and programming capabilities. They know how to create, analyze, share, and integrate BI in a Hadoop environment.

The current situation is a shortage of Hadoop talent, some companies have to rely on Hadoop vendors to provide technical support such as deployment. Hadoop vendors such as Cloudera, MapR, Hortonworks, and IBM now offer Hadoop-related technology training courses to help organizations deploy Hadoop hubs.