First, inUbuntuunder CreateHadoopgroups andHadoopUser
Increase the Hadoop user group while adding Hadoop users to the group, and we'll use that user when it comes to Hadoop operations .
1. CreateHadoopUser Groups
2, creatingHadoopUser
sudo adduser-ingroup Hadoop Hadoop
You will be prompted to enter a new UNIX password, which is the password for the new user Hadoop , enter the return.
If you do not enter a password, you will be prompted to enter the password again, that is, the password cannot be empty.
Finally confirm the information is correct, if no problem, enter Y, carriage return.
3, forHadoopUser Add Permission
Input: sudo gedit/etc/sudoers
Enter, open the Sudoers file
Give the Hadoop user the same permissions as the root user
Ii. sign in to the Ubuntu system with the newly added Hadoop user
Third, install SSH
sudo apt-get install Openssh-server
After the installation is complete, start the service
Sudo/etc/init.d/ssh start
To see if the service started correctly: PS-E | grep ssh
Setting up password-free logins, generating private and public keys
Ssh-keygen-t rsa-p ""
Two files are generated under/home/hadoop/.ssh: Id_rsa and Id_rsa.pub, which is the private key and the latter is the public key.
Next we append the public key to Authorized_keys, which saves all the public key content that allows the user to log on to the SSH client as the current user.
Cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
Login to SSH
SSH localhost
Exit
Exit
Iv. installation of the Java environment
sudo apt-get install OPENJDK-7-JDK
To view the installation results, enter the command: Java-version, the results are as follows to indicate that the installation was successful.
Five, installationhadoop2.4.0 1, official website Downloadhttp://mirror.bit.edu.cn/apache/hadoop/common/
2, installation
Extract
sudo tar xzf hadoop-2.4.0.tar.gz
If we're going to install Hadoop under the/usr/local,
Copy to/usr/local/, folder for Hadoop
sudo mv Hadoop-2.4.0/usr/local/hadoop
Give users read and write access to this folder
sudo chmod 774/usr/local/hadoop
3. Configuration
1) Configuration ~/.BASHRC
Before you configure This file, you need to know the Java installation path to set the JAVA_HOME environment variable, you can use the following command line to view the installation path
Update-alternatives--config Java
The results of the implementation are as follows:
The full path is
/usr/lib/jvm/java-7-openjdk-amd64/jre/bin/java
We only take the previous part/USR/LIB/JVM/JAVA-7-OPENJDK-AMD64
Configure the. bashrc file
sudo gedit ~/.BASHRC
The command opens the edit window for the file, appends the following to the end of the file, and then saves and closes the editing window.
#HADOOP VARIABLES START
Export JAVA_HOME=/USR/LIB/JVM/JAVA-7-OPENJDK-AMD64
Export Hadoop_install=/usr/local/hadoop
Export path= $PATH: $HADOOP _install/bin
Export path= $PATH: $HADOOP _install/sbin
Export Hadoop_mapred_home= $HADOOP _install
Export Hadoop_common_home= $HADOOP _install
Export Hadoop_hdfs_home= $HADOOP _install
Export Yarn_home= $HADOOP _install
Export hadoop_common_lib_native_dir= $HADOOP _install/lib/native
Export hadoop_opts= "-djava.library.path= $HADOOP _install/lib"
#HADOOP VARIABLES END
The final results are as follows:
Execute the following to make the added environment variable effective:
SOURCE ~/.BASHRC
2) Edit/usr/local/hadoop/etc/hadoop/hadoop-env.sh
Execute the following command to Open the edit window for the file
sudo gedit/usr/local/hadoop/etc/hadoop/hadoop-env.sh
Locate the Java_home variable and modify the variable as follows
Export JAVA_HOME=/USR/LIB/JVM/JAVA-7-OPENJDK-AMD64
The modified hadoop-env.sh file resembles the following :
Six,WordCount Test
The standalone mode installation is complete, and the following is done by executing the Hadoop self-wordcount to verify that the installation was successful:
Create the input folder under the/usr/local/hadoop path:
mkdir input
(or sudo mkdir/usr/local/hadoop/input)
copy README.txt to input:
CP README.txt Input
execution wordcount:
bin/hadoop jarshare/hadoop/mapreduce/sources/ Hadoop-mapreduce-examples-2.4.0-sources.jarorg.apache.hadoop.examples.wordcount Input Output
Execution Result:
Perform cat output/* to view character statistics results
At this point, stand-alone mode installation success!
One, Ubuntu14.04 install Hadoop2.4.0 (standalone mode)