Eclipse installs the Hadoop plugin

Source: Internet
Author: User
Tags deprecated shuffle log4j

First explain the configured environment

System: Ubuntu14.0.4

Ide:eclipse 4.4.1

Hadoop:hadoop 2.2.0

For older versions of Hadoop, you can directly replicate the Hadoop installation directory/contrib/eclipse-plugin/hadoop-0.20.203.0-eclipse-plugin.jar to the Eclipse installation directory/plugins/ (and not personally verified). For HADOOP2, you need to build the jar file by compiling the source code of the Https://github.com/winghc/hadoop2x-eclipse-plugin download plugin yourself. To get started, download the compiled jar file directly from someone else, copy it to Eclipse's plugins folder, but after restarting Eclipse, you can't find the Map/reduce plugin in open perspective. Then guess the compiler needs to rely on the plug-in, and then decide to compile.

Download the source code of the plugin, it has a clear way to compile

How to BUILD$CD src/contrib/eclipse-plugin$ant jar-dversion=2.2.0-declipse.home=/opt/eclipse -Dhadoop.home =/usr/share/hadoopfinal jar is genrated at directory$root/build/contrib/eclipse-plugin/ Hadoop-eclipse-plugin-2.2.0.jar

From the above, you need to specify the home directory for Hadoop and Eclipse, which is the result of my first compilation

[Email protected]:~/download/hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin$ ant jar-dversion=2.2.0- Declipse.home=/usr/local/eclipse-dhadoop.home=/usr/local/hadoop/hadoop-2.2.0buildfile:/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin/build.xmlcheck-contrib:init: [echo] Contrib: Eclipse-plugininit-contrib:ivy-download: [Get] getting:http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.1.0/  Ivy-2.1.0.jar [get] to:/home/hadoop/download/hadoop2x-eclipse-plugin-master/ivy/ivy-2.1.0.jar [get] not modified-so Not downloadedivy-probe-antlib:ivy-init-antlib:classpath element/home/hadoop/Download/hadoop2x-eclipse-plugin-master/  Ivy/ivy-2.1.0.jar is a jar. [typedef]CLASSPATH element/home/hadoop/Download/hadoop2x-eclipse-plugin-master/ivy/ivy-2.1.0.jar is a jar.[typedef] Could not load definitions from resource Org/apache/ivy/ant/antlib.xml. It could not being found.BUILD FAILED/home/hadoop/download/hadoop2x-eclipse-plugin-master/src/contrib/build-contrib.xml:476:you need Apache Ivy 2.0 or later From Http://ant.apache.org/It could not being loaded from http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.1.0/ivy-2. 1.0.jarTotal Time:1 Second

Compile failed, if the computer is networked, it will automatically download the Ivy-2.1.0.jar file, copy the downloaded files to the appeal directory, recompile

[Email protected]:~/download/hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin$ ant jar-dversion=2.2.0- Declipse.me=/usr/local/eclipse-dhadoop.home=/usr/local/hadoop/hadoop-2.2.0buildfile:/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin/build.xmlcheck-contrib:init: [echo] Contrib: Eclipse-plugininit-contrib:ivy-download: [Get] getting:http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.1.0/  Ivy-2.1.0.jar [get] to:/home/hadoop/download/hadoop2x-eclipse-plugin-master/ivy/ivy-2.1.0.jar [get] not modified-so Not Downloadedivy-probe-antlib:ivy-init-antlib:ivy-init:[ivy:configure]:: Ivy 2.1.0-20090925235825::/HTTP/ ant.apache.org/ivy/:: [ivy:configure]:: Loading settings:: File =/home/hadoop/Download/hadoop2x-eclipse-plugin-master/ivy /ivysettings.xmlIvy-resolve-common:Ivy-retrieve-common:[ivy:cachepath] DEPRECATED: ' Ivy.conf.file ' is DEPRECATED, use ' Ivy.settings.file ' Instead[ivy: CachePath]:: Loading settings:: File =/home/hadoop/download/hadoop2x-eclipse-plugin-master/ivy/ivysettings.xmlcompile: [E Cho] contrib:eclipse-plugin [javac]/home/hadoop/Download/hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin/ Build.xml:76:warning: ' Includeantruntime ' is not set, defaulting to Build.sysclasspath=last; Set to False for repeatable builds [Javac] compiling source files to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/ build/contrib/eclipse-plugin/classes [Javac]/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/ Hadoop-common-2.2.0.jar (Org/apache/hadoop/fs/path.class): Warning: Cannot find Comment method ' value () ' for type ' limitedprivate ': Could not find class file for Org.apache.hadoop.classification.InterfaceAudience [Javac]/usr/local/hadoop/hadoop-2.2.0/share/hadoop/ Hdfs/hadoop-hdfs-2.2.0.jar (Org/apache/hadoop/hdfs/distributedfilesystem.class): Warning: Unable to find comment method for type ' LimitedPrivate ' VaLue () ' [Javac]/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar (org/apache/hadoop/fs/ Filesystem.class): Warning: Unable to find comment method of type ' Limitedprivate ' ' value () ' [Javac]/usr/local/hadoop/hadoop-2.2.0/share/hadoop/ Common/hadoop-common-2.2.0.jar (Org/apache/hadoop/fs/filesystem.class): Warning: Unable to find comment method for type ' Limitedprivate ' ' value () ' [ Javac]/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar (org/apache/hadoop/fs/ Filesystem.class): Warning: Unable to find comment method of type ' Limitedprivate ' ' value () ' [Javac]/usr/local/hadoop/hadoop-2.2.0/share/hadoop/ Common/hadoop-common-2.2.0.jar (Org/apache/hadoop/fs/fsdatainputstream.class): Warning: Unable to find comment method for type ' limitedprivate ' Value () ' [Javac]/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar (org/apache/hadoop/fs    /fsdataoutputstream.class): Warning: Unable to find comment method for type ' Limitedprivate ' ' value () ' [Javac] Note: Some input files use or overwrite outdated APIs.    [Javac] Note: For more information, please use-xlint:deprecation to recompile.    [Javac] Note: Some input files use an unchecked or unsafe operation. [jAVAC] Note: For more information, please use-xlint:unchecked to recompile. [Javac] 7 warning JAR: [mkdir] Created dir:/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/ lib [copy] Copying 9 files to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib [Cop Y] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar to/home/ hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Hadoop-mapreduce-client-app-2.2.0.jar [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/ Hadoop-mapreduce-client-common-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib/hadoop-mapreduce-client-common-2.2.0.jar [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/ Hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/ Contrib/eclipse-plugin/lib/hadoop-mapreduce-client-core-2.2.0.jar [Copy] CopyinG/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-mapreduce-client-hs-2.2.0.jar [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar to/ home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Hadoop-mapreduce-client-hs-plugins-2.2.0.jar [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce /hadoop-mapreduce-client-jobclient-2.2.0-tests.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/ Contrib/eclipse-plugin/lib/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar [Copy] copying/usr/local/hadoop/ Hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-mapreduce-client-jobclient-2.2.0.jar [ Copy] Copying/usr/local/hadoop/hadoOp-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-mapreduce-client-shuffle-2.2.0.jar [Copy ] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar to/home/ hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-mapreduce-examples-2.2.0.jar [ Copy] Copying 3 files to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib [copy] Copyi Ng/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0-tests.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-common-2.2.0-tests.jar [Copy] Copying/usr /local/hadoop/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-common-2.2.0.jar [Copy] Copying/usr/local /hadoop/hadoop-2.2.0/share/hadoop/common/hadoop-nfs-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib/hadoop-nfs-2.2.0.jar [Copy] Copying 3 files to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/ build/contrib/eclipse-plugin/lib [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/hdfs/ Hadoop-hdfs-2.2.0-tests.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Hadoop-hdfs-2.2.0-tests.jar [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-2.2.0.jar to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-hdfs-2.2.0.jar [copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-hdfs-nfs-2.2.0.jar [Copy] Copying files to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib [copy] Copying/usr/locaL/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-yarn-api-2.2.0.jar [Copy] copying/usr/ Local/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar to/home/hadoop/ Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Hadoop-yarn-applications-distributedshell-2.2.0.jar [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/ Yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/ Build/contrib/eclipse-plugin/lib/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar [Copy] copying/usr/ Local/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-yarn-client-2.2.0.jar [Copy] copying/usr/ Local/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-yarn-common-2.2.0.jar [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-yarn-server-common-2.2.0.jar [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar To/home/hadoop /Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/hadoop-yarn-server-nodemanager-2.2.0.jar [ Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar to/ home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Hadoop-yarn-server-resourcemanager-2.2.0.jar [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/yarn/ Hadoop-yarn-server-tests-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib/hadoOp-yarn-server-tests-2.2.0.jar [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/yarn/ Hadoop-yarn-server-web-proxy-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib/hadoop-yarn-server-web-proxy-2.2.0.jar [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/ Hadoop/yarn/hadoop-yarn-site-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib/hadoop-yarn-site-2.2.0.jar [Copy] Copying 1 file to/home/hadoop/download/ hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib [Copy] copying/usr/local/hadoop/hadoop-2.2.0/ Share/hadoop/common/lib/protobuf-java-2.5.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib/protobuf-java-2.5.0.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/ build/contrib/eclipse-plugin/lib [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/ Log4j-1.2.17.jar to/home/hadoop/Download/haDoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/log4j-1.2.17.jar [Copy] Copying 1 file To/home/hadoop /download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib [copy] copying/usr/local/hadoop/hadoop-2.2.0 /share/hadoop/common/lib/commons-cli-1.2.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib/commons-cli-1.2.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build /contrib/eclipse-plugin/lib [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/ Commons-configuration-1.6.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib /commons-configuration-1.6.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib /eclipse-plugin/lib [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/commons-lang-2.5.jar to/ home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/coMmons-lang-2.5.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/ eclipse-plugin/lib [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/ Jackson-core-asl-1.8.8.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Jackson-core-asl-1.8.8.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/ eclipse-plugin/lib [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/ Jackson-mapper-asl-1.8.8.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Jackson-mapper-asl-1.8.8.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/ eclipse-plugin/lib [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/slf4j-log4j12-1.7.5.jar [copy ] Copying 1 fiLe to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib [copy] copying/usr/local/ Hadoop/hadoop-2.2.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar to/home/hadoop/Download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/slf4j-api-1.7.5.jar [Copy] Copying 1 file to/home/ hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib [copy] copying/usr/local/hadoop/ Hadoop-2.2.0/share/hadoop/common/lib/guava-11.0.2.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/ Contrib/eclipse-plugin/lib/guava-11.0.2.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/ build/contrib/eclipse-plugin/lib [Copy] copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/ Hadoop-auth-2.2.0.jar to/home/hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/ Hadoop-auth-2.2.0.jar [Copy] Copying 1 file to/home/hadoop/download/hadoop2x-eclipse-plugin-master/build/contrib/ Eclipse-plugin/lib [Copy] Copying/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/netty-3.6.2.final.jar to/home/hadoop/download/ Hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/lib/netty-3.6.2.final.jar [jar] Building jar:/home/ hadoop/Download/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/hadoop-eclipse-plugin-2.2.0.jarbuild Successfultotal time:36 seconds


The location of the Ivy-resolve-common may be waiting for some time. Then copy the generated Hadoop-eclipse-plugin-2.2.0.jar to Eclipse's plugins folder, restart Eclipse, and see that the Hdoop plugin has been successfully installed


Record your installation procedure above, if there are omissions or errors, do not hesitate to enlighten

Eclipse installs the Hadoop plugin

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.