I. Hadoop cluster environment configuration
Refer to my previous post (Ubuntu + hadoop2.5.2 Distributed Environment Configuration http://www.cnblogs.com/huligong1234/p/4136331.html) I was compiled on my own Linux one by one, CentOS 64-bit compilation environment:
Two. Windows Basic Environment Preparation
Windows7 (x64), Jdk,ant,eclipse,hadoop
1.JDK Environment Configuration
Jdk-6u26-windows-i586.exe Configure the relevant JAVA_HOME environment variable after installation and configure the bin directory to path
2.eclipse Environment Configuration
Eclipse-standard-luna-sr1-win32.zip extracted to the D:\eclipse\ directory and named Eclipse-hadoop
: Http://developer.eclipsesource.com/technology/epp/luna/eclipse-standard-luna-SR1-win32.zip
3.ant Environment Configuration
Apache-ant-1.9.4-bin.zip unzip to the D:\apache\ directory, configure the environment variable Ant_home, and configure the bin directory to the path
: Http://mirror.bit.edu.cn/apache//ant/binaries/apache-ant-1.9.4-bin.zip
4. Download hadoop-2.5.2.tar.gz
Http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz
5. Download hadoop-2.5.2-src.tar.gz
Http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.5.2/hadoop-2.5.2-src.tar.gz
6. Download Hadoop2x-eclipse-plugin
Https://github.com/winghc/hadoop2x-eclipse-plugin
7. Download Hadoop-common-2.2.0-bin
Https://github.com/srccodes/hadoop-common-2.2.0-bin
Extract hadoop-2.5.2.tar.gz, hadoop-2.5.2-src.tar.gz, Hadoop2x-eclipse-plugin, hadoop-common-2.2.0-bin download to F:\hadoop\ respectively Directory under
third, compile Hadoop-eclipse-plugin-2.5.2.jar configuration
1. Add environment variable Hadoop_home=f:\hadoop\hadoop-2.5.2\
Append environment variable path content:%hadoop_home%/bin
2. Modify the compilation package and dependent package version information
Modify F:\hadoop\hadoop2x-eclipse-plugin-master\ivy\libraries.properties
hadoop.version=2.5.2
jackson.version=1.9.13
3.ant compilation
F:\hadoop\hadoop2x-eclipse-plugin-master\src\contrib\eclipse-plugin>
Ant jar-dversion=2.5.2-declipse.home=d:\eclipse\eclipse-hadoop\eclipse-dhadoop.home=f:\hadoop\hadoop-2.5.2
After compiling, the Hadoop-eclipse-plugin-2.5.2.jar will be in the F:\hadoop\hadoop2x-eclipse-plugin-master\build\contrib\eclipse-plugin directory.
Intermediate may be compiled encountered
I can't find the Htrace-core-3.0.4.jar.
Download Htrace-core-3.0.4.jar, Link: http://mvnrepository.com/artifact/org.htrace/htrace-core/3.0.4
and copy the package to the hadoop-2.5.2/share/hadoop/common/lib/directory
Recompile! Success!
Configuration:
The compiled plugin is already in the Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin directory: Hadoop-eclipse-plugin-2.5.2.jar
1) Copy the Hadoop-eclipse-plugin-2.5.2.jar to your Eclispe/plugins directory and restart the Eclpise
2) in the Eclipse menu click windows→show view→other ..., select the " ShowView" dialog box to open, the search box enter "map", will find the item " Map/reducelocations ", click on" OK "button
3) on the "Map/reduce Locations" tab, click on the icon or in the blank place right click, select "New Hadoop location ...", Pop Up the dialog "new Hadoop location ...", configure the following:
iv. Configuration of the Eclipse environment
1. Copy the compiled Hadoop-eclipse-plugin-2.5.2.jar to the plugins directory of Eclipse and restart eclipse
2. Open the menu Window--preference--hadoop map/reduce to configure as shown in:
3. Display the Hadoop Connection Configuration window: Window--show view--other-mapreduce Tools, as shown in:
4. Configure the connection to Hadoop as shown in
Hadoop 2.5.2 Eclipse plugin compilation Win7 integration
