Install the CDH 5.2.1 cluster in centos 6.5 (1)

Three cluster nodes

192.168.1.170 CDH-Master

Cdh-slave-1 192.168.1.171

Cdh-slave-2 192.168.1.171

1. Install centos6.5 (64-bit) and set up the basic environment, including:

(1) Add sudo Permissions

(2) modify the host name, gateway, static IP address, and DNS

(3) Disable SELinux and Firewall

Refer to the article

(4) modify the system time zone and configure the NTP service (select the host machine to configure the NTP server, refer to the article)

2. Clone the three hosts and modify static IP addresses, MAC addresses, host names, and hosts files respectively:

Modify the/etc/sysconfig/network file of the Host Name and gateway

Mac modification/etc/udev/rules. d/70-persistent-net.rules

The IP address is modifying/etc/sysconfig/network-scripts/ifcfg-eth0

To modify the host file/etc/hosts, you need to add the correspondence between all host names and IP addresses in the cluster, and the host name must be exactly the same as the real host name (/etc/sysconfig/network ).

3. Download The clouder-manger installation package and the parcel file:

CM File

Cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Cloudera-manager-server-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Jdk-6u31-linux-amd64.rpm

Oracle-j2sdk1.7-1.7.0 + update67-1.x86_64.rpm

Parcel

CDH-5.2.1-1.cdh5.2.1.p0.12-el6.parcel

4. Install daemons, server, and agent on the master node (first install daemons)

Yum -- nogpgcheck localinstall cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Yum -- nogpgcheck localinstall cloudera-manager-server-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Yum -- nogpgcheck localinstall cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm(Note: The agent must be connected to the Internet)

5. Install daemons and agent on slave-1 and slave-2 nodes (first install daemons)

Yum -- nogpgcheck localinstall cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Yum -- nogpgcheck localinstall cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm(Note:: The agent must be connected to the Internet)

6. Install JDK and oraclejdk on Master, slave-1, and slave-2 nodes

Rpm-IVH jdk-6u31-linux-amd64.rpm

7. Install the MySQL database on the master node and configure the database options required by CDH.

Yum install mysql-server MySQL mysql-deve(Note: Networking is required)

Chkconfig mysqld on

Service mysqld start

Mysql-u Root

Use MySQL

Update user SET Password = PASSWORD ('20140901') where user = 'root'

Update user SET Password = PASSWORD ('20140901') where host = 'localhost'

Update user SET Password = PASSWORD ('20140901') where host = 'cdh-mater'

Service mysqld restart

Mysql-u root-p1234

Create Database cloudera

8. Configure the cloudera Manager Database on the master node and start the Server and Agent program of CM.

1. Copy mysql-connector-java-5.1.7-bin.jar to/usr/share/Java and rename mysql-connector-java.jar

2. Run the command/usr/share/CMF/Schema/scm_prepare_database.sh-h cdh-master MySQL cloudera root 1234.

3. Start cm server: Service cloudera-SCM-Server start

4. Add cm Server Service: chkconfig cloudera-SCM-server on

5. Start cm agent: chkconfig cloudera-SCM-agent on

6. Add cm agent service: Service cloudera-SCM-Server start

9Modify the agent configuration file of all nodes

/Etc/cloudera-SCM-agent/config. ini: Change the host in the configuration file to CDH-master.

10. Configure the cloudera manager agent program on the slave Node

1. Start cm agent: chkconfig cloudera-SCM-agent on

2. Add cm agent service: Service cloudera-SCM-Server start

11. test whether the communication between the agent and the server is successful

Service cloudera-SCM-Server Status

Service cloudera-SCM-agent status

Netstat-anp | grep 7182

# Port 7182 is enabled on the server for communication with the agent.

You can view logs when startup fails.

Server log/var/log/cloudera-SCM-Server

Agent log/var/log/cloudera-SCM-agent

12. Upload the downloaded parcel file and the Sha file and manifest. JSON file of the corresponding version on the official website to the/opt/cloudera/parcel-repo directory.

13. Start the browser and start cluster web installation and configuration

Install the CDH 5.2.1 cluster in centos 6.5 (1)