Hadoop2.6.0 Pseudo-distributed environment construction

Software used:

First, install the JDK:

1, to install the JDK, I copied it in the shared folder inside.

(You can also use a USB stick)

2. I copied the JDK under the user folder.

(Other places are possible, but the path should be changed accordingly)

3. Perform the Copy Installation Decompression command:

Decompression Complete:

To view the extracted folders:

4. Configure Environment variables:

Write the following 5 lines of code:

To make the configuration effective:

5. View the installed JDK:

Java-version

Java

Javac

Second, SSH password-free login:

1. Install SSH:

2. Whether to generate the. SSH directory:

3. If there is no build, manually create a. SSH Directory yourself:

The generated. SSH directory:

4. Generate the public and private keys:

The effect is as follows:

5.Add the public key to the public key file for authentication:

6. Password-free login:

Effect:

Ubuntu Password-free login, SSH configuration is complete.

Third, installation configuration Hadoop:

1, replication installation decompression Hadoop:

Decompression Complete Effect:

2, configuration Etc/profile

3, configuration hadoop-env.sh

Enter

4, modify the hadoop-2.6.0 file permissions for the user rights:

By default there is no Mapred-site.xml file, copy mapred-site.xml.template, and change the name to Mapred-site.xml

5, configuration of the following 4 important files:

Mapred-site.xml

Core-site.xml

Hdfs-site.xml

Yarn-site.xml

6. Format:

Formatting part of the effect:

7. Start:

Start start-dfs.shFirst:

Effect:

Re-start start-yarn.sh:

Effect:

Turn off Hadoop:

(Note: You can also sbin/start-all.sh: It is recommended to start separately.) ), as follows:

8. View Web page information:

At this point, the hadoop-2.6.0 pseudo distribution is configured successfully.

Hadoop2.6.0 Pseudo-distributed environment construction