Cloudera Manager 5.3.2 and CDH5.3.2 environment Configuration

Cloudera Manager 5.3.2 and CDH5.3.2 environment Configuration

System Environment

9 DELL R720xd servers (192.168.3.245-253) and 1 r0000master node (192.168.3.243)
NIC: 1000 M
Each of the nine DELL R720xd servers has 12x4 TB disks.
Network Environment Intranet
CentOS6.6 x64 (Final)
 

1. Prepare for uninstallation system comes with OPEN-JDK (all nodes)
The installed Centos system sometimes automatically installs OpenJdk. Run the java-version command to view the information:

Java version "1.6.0"

OpenJDK Runtime Environment (build 1.6.0-b09)

OpenJDK 64-Bit Server VM (build 1.6.0-b09, mixed mode)

If the above information is displayed, OpenJdk is already available in the system. Run the following command to check which OpenJdk packages are available in the system:

Rpm-qa | grep java

As the package must be uninstalled,

Rpm-e -- nodeps java-1.5.0-gcj-1.5.0.0-29.1.el6.x86_64

Rpm-e -- nodeps java-1.6.0-openjdk-1.6.0.0-1.66.1.13.0.el6.x86_64

Rpm-e -- nodeps java-1.6.0-openjdk-devel-1.6.0.0-1.66.1.13.0.el6.x86_64

Here, we have uninstalled OpenJDK in the initial environment and installed JDK 1.7.

View:

Java-version

Javac-version

 

2. Modify the Host Name (so the node)
The host file has been configured in the initial environment. All nodes must synchronize the host file. This step is omitted.

 

3. SSH connection (all nodes)
The purpose is to log on from the master node to all nodes without entering a password.

4. Disable the firewall (all nodes)
The firewall may cause various exceptions in Hadoop-related component communication.

Firewall:
Service iptables stop (temporarily disabled)

Chkconfig iptables off (effective after restart)

SELINUX:
Setenforce 0 (temporarily effective)

Modify selinux = disabled under/etc/SELINUX/config (effective after restart ).

 

5. Install the NTP service
Start the NTP service and start it automatically.

Service ntpd start

Chkconfig ntpd on

6. Install Cloudera Manager
1. Create a local directory, such as/data/var/cloudera_manager. Download the appropriate rpm package to the local directory and select CM5.3.2 and the rpm package address.
Http://archive.cloudera.com/cm5/RedHat/6/x86_64/cm/5.3.2/RPMS/x86_64/

Download all rpm packages

2. Install createrepo and create the yum Source

1) yum-y install createrepo

2) Go to the rpm package directory/data/var/cloudera_manager downloaded in step 1 and run createrepo. (Note that there is a point number)

3. Install httpd to provide http Services

Yum-y install httpd

4. Create a soft link to/data/var/cloudera_manager in the/etc/www/http directory.

Ln-s/data/var/cloudera_manager
5. Start the httpd service

/Etc/init. d/httpd start, and then you can check whether http: // 192.168.3.243/cloudera_manager can be accessed through a browser

6. Add the cloudera-manager.repo file under/etc/yum. repo. d with the following content:

[Cloudera-manager]

Name = Cloudera Manager

Baseurl = http: // 192.168.3.243/cloudera_manager

Gpgcheck = 0

7. Run the cloudera-manager-installer.bin and add parameters later so that it no longer generates cloudera-manager.repo files under/etc/yum. repo. d/

/Cloudera-manager-installer.bin -- skip_repo_package = 1

Now, select the corresponding page to successfully install ClouderaManager on the Intranet server.

After installation, a URL is displayed, which can be accessed through the browser address. The user password is admin.

7. Install CDH5.3.2
Download idea

When installing cloudera_manager, You need to configure and select the yum source, and change it to custom. Fill in the above baseurl: http: // 192.168.3.243/cloudera_manager for the address, in this way, cm will place the yum on the added server. the address in the repo is the yum source that can be accessed by your intranet server. It will not be a problem in subsequent installation.

 

If you select to install Hive during installation, the installation may fail. Check the log and find that the JDBC driver must be installed when installing Hive, so we also copy the Mysql driver package to the/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.47/lib/hive/lib/directory, and then continue to install will not encounter problems.

Install Cloudera Manager5.3.2 in CentOS 6.5

Cloudera Manager and CDH 4 ultimate Installation

Install Hadoop through Cloudera Manager

This article permanently updates the link address: