Installation and setup of Hadoop (1)

The main process for installing and setting up Hadoop under Ubuntu.

1. Create a Hadoop user

Create a user named Hadoop and create the user's home directory under home without detailed description.

2. Installing the Java Environment

Download the jdk:jdk-8u111-linux-x64.tar.gz under Linux environment.

Create a Java folder under USR, copy the jdk-8u111-linux-x64.tar.gz to the Java folder, and unzip it.

For ease of operation, create a link for the JDK folder:

To edit the/etc/profile file, add the following statement at the bottom of the file to set the Java environment variable:

New login or enter the Source/etc/profile command to make the profile file effective.

Finally, enter the Java-version command, which shows that the Java environment was successfully installed.

3. Install and set up SSH

Hadoop requires SSH login, Ubuntu has SSH Client installed, and SSH Server is required. Enter the command:

Enter SSH localhost to log on to this machine, but you will need to enter a password. To implement a password-free login, you also need to enter the following command:

The above command creates the RSA key so that you can log on with the RSA key and no more passwords are required.

4. Installing Hadoop

Download hadoop-2.7.3.tar.gz, create a Hadoop folder under usr/local/, copy the hadoop-2.7.3.tar.gz to the folder, unzip it, and rename the hadoop2.7.3 folder to Hadoop for ease of operation. To test whether Hadoop is available, you can test it by entering the following command.

Installation and setup of Hadoop (1)