The configuration of Hadoop in eclipse

After installing the Hadoop framework under Linux and completing the existing WordCount program, we started to build the Eclipse environment under window and write the program.

There are a lot of non-compiled version of the Internet, need to manually edit the relevant, so specifically to find a well-compiled plug-in

Eclipse Version: Sr2-kepler

Java version: 1.8.101

Hadoop version: hadoop2.5.2.tar.gz

Plugins that require Hadoop: Eclipse-hadoop-2.5.2-plugin HTTP://PAN.BAIDU.COM/S/1QYMTEFQ

Installation steps:

First, the hadoop-2.5.2.tar.gz decompression, as the installation directory of Hadoop.

Set the environment variables for Hadoop. In the environment variable, add the Hadoop_home= installation directory, and then add the%hadoop_home%\bin in the PATH variable

Second, modify the Hosts file in the computer.

Go to the C:/window/system32/drive/etc folder to find the Hosts file. Add the relevant IP settings (primarily the IP address of the virtual machine) to the Hosts file, and configure the file to pass the files to each other.

Third, the download of the Hadoop plugin copied to the Eclipse installation directory in the plugin folder, restart Eclipse, and then open window->preferences can see the increase in Hadoop mapreduced options. Results:

When you click this option, the right side of the content appears, adding the Hadoop installation path.

Iv. Configure the associated port configuration for Hadoop in Eclipse.

Click Window->open Perspective->other and the following appears:

Click Map/reduce, then in the right sidebar of Eclipse, the selection of Dfs locations will appear, then left button, then in the control bar below will appear a map/reduced Location control window, click, right under the control window, Create a new Hadoop location,

The edit configuration that appears, and then fill in the IP address and port number of your configuration in Hadoop.

Until now, all of the relevant eclipse configurations have been completed. If the number of files on the original Hadoop cluster is displayed in DFS location, then the connection is successful and if it does not, the connection is unsuccessful and the relevant query needs to be made. Correct the error.

You need to enter the test phase below.

①, creating a new project

Select Map/reduce Project project to create related projects.

The configuration of Hadoop in eclipse