Eclipse+hadoop Environment Construction

Tag: GitHub DFS does not have CLI to make rows compare Hadoop cluster bin com

Operating system: Windows

Hadoop 2.7.4 namenode:192.168.233.135 datanode:192.168.233.134/131

1. Download Hadoop-eclipse-plugin-xxx.jar (https://github.com/winghc/hadoop2x-eclipse-plugin), Unzip to the installation directory of Eclipse under the plugins folder

2. Download Hadoop, unzip to the specified directory, set the environment variable hadoop_home, append to the PATH environment variable, enter Hadoop at the command line, verify that Hadoop is installed correctly

3. Download Hadoop.dll and winutils to the bin directory of the Hadoop installation directory

4. Restart Eclipse, Windows->prefrence will appear Hadoop, set the Hadoop installation path. and select Map/reduce

Note that there are times when eclipse restarts and the Hadoop plugin does not appear because eclipse only remembers the history of plug-in records, and does not update the new plugins, as follows to resolve the following steps:

1) Remove the Eclipse installation path under the configuration directory Org.eclipse.update folder

2) Eclipse-clean restart Eclipse

5. Set up DFS location

You can then see the files for HDFs.

6, add user rights, the native Windows user is XXXX, the Hadoop cluster does not have the user, so the user belongs to the other group, with permission comparison, in HDFs create the home directory of XXX users, and chown, You can operate the remote Hadoop cluster through eclipse.

Eclipse+hadoop Environment Construction