Three cluster nodes
192.168.1.170 CDH-Master
Cdh-slave-1 192.168.1.171
Cdh-slave-2 192.168.1.171
1. Install centos6.5 (64-bit) and set up the basic environment, including:
(1) Add sudo Permissions
(2) modify the host name, gateway, static IP address, and DNS
(3) Disable SELinux and Firewall
Refer to the article
(4) modify the system time zone and configure the NTP service (select the host machine to configure the NTP server, refer to the article)
2. Clone the three hosts and modify static IP addresses, MAC addresses, host names, and hosts files respectively:
Modify the/etc/sysconfig/network file of the Host Name and gateway
Mac modification/etc/udev/rules. d/70-persistent-net.rules
The IP address is modifying/etc/sysconfig/network-scripts/ifcfg-eth0
To modify the host file/etc/hosts, you need to add the correspondence between all host names and IP addresses in the cluster, and the host name must be exactly the same as the real host name (/etc/sysconfig/network ).
3. Download The clouder-manger installation package and the parcel file:
CM File
Cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm
Cloudera-manager-server-5.2.1-1.cm521.p0.109.el6.x86_64.rpm
Cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm
Jdk-6u31-linux-amd64.rpm
Oracle-j2sdk1.7-1.7.0 + update67-1.x86_64.rpm
Parcel
CDH-5.2.1-1.cdh5.2.1.p0.12-el6.parcel
4. Install daemons, server, and agent on the master node (first install daemons)
Yum -- nogpgcheck localinstall cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm
Yum -- nogpgcheck localinstall cloudera-manager-server-5.2.1-1.cm521.p0.109.el6.x86_64.rpm
Yum -- nogpgcheck localinstall cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm(Note: The agent must be connected to the Internet)
5. Install daemons and agent on slave-1 and slave-2 nodes (first install daemons)
Yum -- nogpgcheck localinstall cloudera-manager-daemons-5.2.1-1.cm521.p0.109.el6.x86_64.rpm
Yum -- nogpgcheck localinstall cloudera-manager-agent-5.2.1-1.cm521.p0.109.el6.x86_64.rpm(Note:: The agent must be connected to the Internet)
6. Install JDK and oraclejdk on Master, slave-1, and slave-2 nodes
Rpm-IVH jdk-6u31-linux-amd64.rpm
7. Install the MySQL database on the master node and configure the database options required by CDH.
Yum install mysql-server MySQL mysql-deve(Note: Networking is required)
Chkconfig mysqld on
Service mysqld start
Mysql-u Root
Use MySQL
Update user SET Password = PASSWORD ('20140901') where user = 'root'
Update user SET Password = PASSWORD ('20140901') where host = 'localhost'
Update user SET Password = PASSWORD ('20140901') where host = 'cdh-mater'
Service mysqld restart
Mysql-u root-p1234
Create Database cloudera
8. Configure the cloudera Manager Database on the master node and start the Server and Agent program of CM.
1. Copy mysql-connector-java-5.1.7-bin.jar to/usr/share/Java and rename mysql-connector-java.jar
2. Run the command/usr/share/CMF/Schema/scm_prepare_database.sh-h cdh-master MySQL cloudera root 1234.
3. Start cm server: Service cloudera-SCM-Server start
4. Add cm Server Service: chkconfig cloudera-SCM-server on
5. Start cm agent: chkconfig cloudera-SCM-agent on
6. Add cm agent service: Service cloudera-SCM-Server start
9Modify the agent configuration file of all nodes
/Etc/cloudera-SCM-agent/config. ini: Change the host in the configuration file to CDH-master.
10. Configure the cloudera manager agent program on the slave Node
1. Start cm agent: chkconfig cloudera-SCM-agent on
2. Add cm agent service: Service cloudera-SCM-Server start
11. test whether the communication between the agent and the server is successful
Service cloudera-SCM-Server Status
Service cloudera-SCM-agent status
Netstat-anp | grep 7182
# Port 7182 is enabled on the server for communication with the agent.
You can view logs when startup fails.
Server log/var/log/cloudera-SCM-Server
Agent log/var/log/cloudera-SCM-agent
12. Upload the downloaded parcel file and the Sha file and manifest. JSON file of the corresponding version on the official website to the/opt/cloudera/parcel-repo directory.
13. Start the browser and start cluster web installation and configuration
Install the CDH 5.2.1 cluster in centos 6.5 (1)