Hadoop Multi-node cluster installation Guide

We use 2 nodes to install the Hadoop cluster, where 192.168.129.35 is the primary node and the 192.168.129.34 is from the node.

Create a user named Hadoop-user on both the Master node (192.168.129.35) and from the node (192.168.129.34)

Master node (192.168.129.35) log in Hadoop-user

Because the Hadoop cluster requires a master node to assume the Namenode and Jobtracker daemons, and assume responsibility for connecting and activating other Datanode and Tasktracker daemons from node (slave node). And their communications in Hadoop are using SSH without a password, so we have to configure SSH without a password.

First verify that SSH is installed:

which SSH

Which sshd

Which Ssh-keygen

SSH password is generated on the master node (192.168.129.35)

SSH-KEYGEN-T RSA

View public key information on the master node (192.168.129.35):

Cat ~/.ssh/id_rsa.pub

Copy the public key from the Master node (192.168.129.35) to each Hadoop node, because we already have the master node, so we publish it to the node 192.168.129.34

To run from the Master node (192.168.129.35):

SCP ~/.ssh/id_rsa.pub Hadoop-user@192.168.129.34:~/master_key