Quick installation manual for Hadoop in Ubuntu

I. Environment Ubuntu10.10 + jdk1.6 II. Download & amp; installer 1.1 ApacheHadoop: Download HadoopRelase: uninstall

I. Environment

Ubuntu 10.10 + jdk1.6

Ii. download and install the program

1.1 Apache Hadoop:

Download Hadoop Relase: http://hadoop.apache.org/common/releases.html

Unzip: tar xzf hadoop-x.y.z.tar.gz

1.2 install JDK1.6: sudo apt-get install sun-java6-jdk

3. Configure environment variables and configuration files

1. Environment Variables

Export HADOOP_INSTALL =/opt/hadoop-0.20.2/(Hadoop extract directory)

Export PATH = $ PATH: $ HADOOP_INSTALL/bin

Export HADOOP_COMMON_HOME = $ HADOOP_INSTALL

Export HADOOP_CONF_DIR = $ HADOOP_INSTALL/conf

Export JAVA_HOME =/usr/lib/jvm/java-6-openjdk (JDK directory)

2. Configure Hadoop

2.1 set hadoop JAVA_HOME

Open $ HADOOP_INSTALL/conf/hadoop-env.sh and configure JAVA_HOME as follows:

2.2 set hadoop, hdfs, and mapreduce (pseudo cluster settings, other reference documents)

2.2.1 set the core-site.xml as follows:

Fs. default. name

Hdfs: // localhost: 9000/

Hadoop. tmp. dir

/Home/john/hadoop/

Detailed configuration item reference: hadoopinstal/doc/core-default.html

2.2.2 set the hdfs-site.xml as follows:

Dfs. replication

1

Detailed configuration item reference: hadoopinstal/doc/hdfs-default.html

2.2.3 set mapred-site.xml, as follows:

Mapred. job. tracker

Localhost: 9001

Detailed configuration item reference: hadoopinstal/doc/mapred-default.html

Iv. Format Hadoop & Run Hadoop

Run the following command on the console: hadoop namenode-format

Run: start. all. sh

Verify whether the installation is successful:

Browser: http: // localhost: 50030

(Localhost Hadoop Map/Reduce Administration)

Http: // localhost: 50070

(NameNode 'localhost. localdomain: 8020 ')

5. Install Eclipse plugin

Different Versions of Hadoop require different plugins and must be compiled by yourself. In version 0.20.2, all the compiled plugins are included in the release package, the directory is in (extract directory/contrib/eclipse-plugin /). There are many problems with compiling plugin. If you need to make a bet first, we recommend that you install version 0.20.2. Put hadoop-*-eclipse-plugin.jar, cp to the "eclipse installation directory/eclise/plugins"

Note that do not modify the hadoop-*-eclipse-plugin.jar name, and then restart eclipse,

View the plug-in such: