Articles on the establishment of the Hadoop + Zookeeper + HBase platform on the Internet can be said to be overwhelming and numerous. Here we will publish a very basic document left behind when we configure this platform, for your reference, you are welcome to raise any questions.
Start with the most basic configuration of the Hadoop platform.
L first, configure the Host Name and IP address, and the hosts file corresponding to the Host Name and IP address.
The IP address distribution of the final configured node is as follows:
Machine name |
IP address |
Master. Hadoop |
192.168.117.122 |
Slave1.Hadoop |
192.168.117.121 |
Slave2.Hadoop |
192.168.117.120 |
1. view the current host name:
2. Modify the name of the current host:
Run the hostname command in the previous document.
Effect After reboot is found
The original modification of the host name with hostname only applies to this operation. After reboot, the host name will be restored to the HOSTNAME value in/etc/sysyconfig/network.
Modify the host name to continue. To modify the host name, you must switch to the root user. Normal users cannot modify the files in the/etc folder. It cannot be saved after modification. The prompt is read-only.
Switch users. Modify the HOSTNAME value again, and then reboot the host will be able to permanently modify the host name.
3. Modify the IP address of the current host
The IP address information is stored in the/etc/sysconfig/network-scripts folder and needs to be configured on the ifcfg-eth0 file. :
You can run the ifconfig command to view the changes.
You can skip the graph here.
4. Configure the hosts file
The/etc/hosts file is used to configure the DNS server information to be used by the host. When you connect to the host name in the cluster, view the IP address of the host name.
Add the following information to/etc/hosts, and configure the other two hosts as well.
192.168.117.122
Master. Hadoop
192.168.117.121
Slave1.Hadoop
192.168.117.120
Slave2.Hadoop
Modify the master node as follows:
Test results:
The configuration is successful.
5. Configure the 1-4 configuration in the same way to the Slave1.Hadoop and Slave2.Hadoop nodes.
L Required Software
1. JDK Software
JDK: jdk-7u45-linux-i586.tar.gz
: Http://www.Oracle.com/technetwork/java/javase/downloads/jdk7-downloads-1880260.html
Build a Hadoop environment on Ubuntu 13.04
Cluster configuration for Ubuntu 12.10 + Hadoop 1.2.1
Build a Hadoop environment on Ubuntu (standalone mode + pseudo Distribution Mode)
Configuration of Hadoop environment in Ubuntu
Detailed tutorial on creating a Hadoop environment for standalone Edition
Build a Hadoop environment (using virtual machines to build two Ubuntu systems in a Winodws environment)