I. Environment Ubuntu10.10 + jdk1.6 II. Download & amp; installer 1.1 ApacheHadoop: Download HadoopRelase: uninstall
I. Environment
Ubuntu 10.10 + jdk1.6
Ii. download and install the program
1.1 Apache Hadoop:
Download Hadoop Relase: http://hadoop.apache.org/common/releases.html
Unzip: tar xzf hadoop-x.y.z.tar.gz
1.2 install JDK1.6: sudo apt-get install sun-java6-jdk
3. Configure environment variables and configuration files
1. Environment Variables
Export HADOOP_INSTALL =/opt/hadoop-0.20.2/(Hadoop extract directory)
Export PATH = $ PATH: $ HADOOP_INSTALL/bin
Export HADOOP_COMMON_HOME = $ HADOOP_INSTALL
Export HADOOP_CONF_DIR = $ HADOOP_INSTALL/conf
Export JAVA_HOME =/usr/lib/jvm/java-6-openjdk (JDK directory)
2. Configure Hadoop
2.1 set hadoop JAVA_HOME
Open $ HADOOP_INSTALL/conf/hadoop-env.sh and configure JAVA_HOME as follows:
2.2 set hadoop, hdfs, and mapreduce (pseudo cluster settings, other reference documents)
2.2.1 set the core-site.xml as follows:
Fs. default. name
Hdfs: // localhost: 9000/
Hadoop. tmp. dir
/Home/john/hadoop/
Detailed configuration item reference: hadoopinstal/doc/core-default.html
2.2.2 set the hdfs-site.xml as follows:
Dfs. replication
1
Detailed configuration item reference: hadoopinstal/doc/hdfs-default.html
2.2.3 set mapred-site.xml, as follows:
Mapred. job. tracker
Localhost: 9001
Detailed configuration item reference: hadoopinstal/doc/mapred-default.html
Iv. Format Hadoop & Run Hadoop
Run the following command on the console: hadoop namenode-format
Run: start. all. sh
Verify whether the installation is successful:
Browser: http: // localhost: 50030
(Localhost Hadoop Map/Reduce Administration)
Http: // localhost: 50070
(NameNode 'localhost. localdomain: 8020 ')
5. Install Eclipse plugin
Different Versions of Hadoop require different plugins and must be compiled by yourself. In version 0.20.2, all the compiled plugins are included in the release package, the directory is in (extract directory/contrib/eclipse-plugin /). There are many problems with compiling plugin. If you need to make a bet first, we recommend that you install version 0.20.2. Put hadoop-*-eclipse-plugin.jar, cp to the "eclipse installation directory/eclise/plugins"
Note that do not modify the hadoop-*-eclipse-plugin.jar name, and then restart eclipse,
View the plug-in such: