Build and install the Hadoop environment in Ubuntu 14.04.4
Build and install the Hadoop environment in Ubuntu 14.04.4
I. Prepare the environment:
1, 64-bit ubuntu-14.04.4
Jdk-7u80-linux-x64 2
2. Configure jdk:
1. Enter the command statement:
2. Write configuration information:
3. Make the configuration information take effect:
4. jdk setup successful:
Iii. hadoop Configuration:
1. Decompress hadoop:
Hadoop @ master:/mysoftware $ tar-zxvf hadoop-2.6.4.tar.gz
2, modify hadoop-env.sh
3, modify core-site.xml:
<configuration> <property> <name>fs.defaultFS</name> <value>hdfs://master:9000</value> </property> <property> <name>hadoop.tmp.dir</name> <value>file:/mysoftware/hadoop-2.6.4/tmp</value> </property> <property> <name>hadoop.native.lib</name> <value>false</value> </property> </configuration>
4. Modify hdfs-site.xml:
<configuration> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>file:/mysoftware/hadoop-2.6.4/dfs/name</value> </property> <property> <name>dfs.datanode.data.dir</name> <value>file:/mysoftware/hadoop-2.6.4/dfs/data</value> </property> <property> <name>dfs.permissions</name> <value>false</value> </property> </configuration>
5, modify mapred-site.xml:
<configuration> <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property></configuration>
6, modify yarn-site.xml:
<configuration> <property> <description>The hostname of the RM.</description> <name>yarn.resourcemanager.hostname</name> <value>master</value> </property> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce.shuffle</value> </property></configuration>
7. Create a folder:
8. Modify permissions:
9. Modify hostsname:
10. Modify host information:
Use # To comment out the previous host name with the Virtual Machine IP address and name:
11. Format hadoop:
Hadoop @ master:/mysoftware/hadoop-2.6.4 $ bin/hdfs namenode-format
If the following information is displayed, the operation is successful:
12. Start hadoop:
Hadoop @ master:/mysoftware/hadoop-2.6.4 $ sbin/start-dfs.sh
Input: hadoop @ master:/mysoftware/hadoop-2.6.4 $ jps
If you see these five processes, the operation is successful.
By the way, it is installed with pseudo-distributed.
You may also like the following articles about Hadoop:
Tutorial on standalone/pseudo-distributed installation and configuration of Hadoop2.4.1 under Ubuntu14.04
Install and configure Hadoop2.2.0 on CentOS
Build a Hadoop environment on Ubuntu 13.04
Cluster configuration for Ubuntu 12.10 + Hadoop 1.2.1
Build a Hadoop environment on Ubuntu (standalone mode + pseudo Distribution Mode)
Configuration of Hadoop environment in Ubuntu
Detailed tutorial on creating a Hadoop environment for standalone Edition