Install the CDH 5.2.1 cluster in centos 6.5 (1)

Source: Internet
Author: User

Three cluster nodes

192.168.1.170 CDH-Master

Cdh-slave-1 192.168.1.171

Cdh-slave-2 192.168.1.171

1. Install centos6.5 (64-bit) and set up the basic environment, including:

(1) Add sudo Permissions

(2) modify the host name, gateway, static IP address, and DNS

(3) Disable SELinux and Firewall

Refer to the article

(4) modify the system time zone and configure the NTP service (select the host machine to configure the NTP server, refer to the article)

2. Clone the three hosts and modify static IP addresses, MAC addresses, host names, and hosts files respectively:

Modify the/etc/sysconfig/network file of the Host Name and gateway

Mac modification/etc/udev/rules. d/70-persistent-net.rules

The IP address is modifying/etc/sysconfig/network-scripts/ifcfg-eth0

To modify the host file/etc/hosts, you need to add the correspondence between all host names and IP addresses in the cluster, and the host name must be exactly the same as the real host name (/etc/sysconfig/network ).

3. Download The clouder-manger installation package and the parcel file:

CM File

Cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Cloudera-manager-server-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Jdk-6u31-linux-amd64.rpm

Oracle-j2sdk1.7-1.7.0 + update67-1.x86_64.rpm

Parcel

CDH-5.2.1-1.cdh5.2.1.p0.12-el6.parcel

4. Install daemons, server, and agent on the master node (first install daemons)

Yum -- nogpgcheck localinstall cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Yum -- nogpgcheck localinstall cloudera-manager-server-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Yum -- nogpgcheck localinstall cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm(Note: The agent must be connected to the Internet)

5. Install daemons and agent on slave-1 and slave-2 nodes (first install daemons)

Yum -- nogpgcheck localinstall cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm

Yum -- nogpgcheck localinstall cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm(Note:: The agent must be connected to the Internet)

6. Install JDK and oraclejdk on Master, slave-1, and slave-2 nodes

Rpm-IVH jdk-6u31-linux-amd64.rpm

7. Install the MySQL database on the master node and configure the database options required by CDH.

Yum install mysql-server MySQL mysql-deve(Note: Networking is required)

Chkconfig mysqld on

Service mysqld start

Mysql-u Root

Use MySQL

Update user SET Password = PASSWORD ('20140901') where user = 'root'

Update user SET Password = PASSWORD ('20140901') where host = 'localhost'

Update user SET Password = PASSWORD ('20140901') where host = 'cdh-mater'

Service mysqld restart

Mysql-u root-p1234

Create Database cloudera

8. Configure the cloudera Manager Database on the master node and start the Server and Agent program of CM.

1. Copy mysql-connector-java-5.1.7-bin.jar to/usr/share/Java and rename mysql-connector-java.jar

2. Run the command/usr/share/CMF/Schema/scm_prepare_database.sh-h cdh-master MySQL cloudera root 1234.

3. Start cm server: Service cloudera-SCM-Server start

4. Add cm Server Service: chkconfig cloudera-SCM-server on

5. Start cm agent: chkconfig cloudera-SCM-agent on

6. Add cm agent service: Service cloudera-SCM-Server start

9Modify the agent configuration file of all nodes

/Etc/cloudera-SCM-agent/config. ini: Change the host in the configuration file to CDH-master.

10. Configure the cloudera manager agent program on the slave Node

1. Start cm agent: chkconfig cloudera-SCM-agent on

2. Add cm agent service: Service cloudera-SCM-Server start

11. test whether the communication between the agent and the server is successful

Service cloudera-SCM-Server Status

Service cloudera-SCM-agent status

Netstat-anp | grep 7182

# Port 7182 is enabled on the server for communication with the agent.

You can view logs when startup fails.

Server log/var/log/cloudera-SCM-Server

Agent log/var/log/cloudera-SCM-agent

12. Upload the downloaded parcel file and the Sha file and manifest. JSON file of the corresponding version on the official website to the/opt/cloudera/parcel-repo directory.

13. Start the browser and start cluster web installation and configuration

Install the CDH 5.2.1 cluster in centos 6.5 (1)

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.