Cloudera Manager5 and CDH5 Online (cloudera-manager-installer.bin) installation Detailed documentation

1.1 Description

CDH official installation Deployment documentation, and step details

Http://www.cloudera.com/content/cloudera/zh-CN/documentation/core/v5-3-x/topics/installation_installation.html

Here is the first way Cloudera Manager installs automatically

Cloudera Manager 5 requirements and supported versions specific details

Http://www.cloudera.com/content/cloudera/zh-CN/documentation/core/v5-3-x/topics/cm_ig_cm_requirements.html

1.2 Pre-deployment preparatory work

Do the following work, the deployment of basic no problem

1) The cluster host must have a properly functioning network name resolution system and a properly formatted/etc/hosts file. All cluster hosts must be correctly configured for forward and reverse host DNS resolution.

2) with the root user operation, ssh password-free login between the clusters is unblocked, thus ensuring that the required directories are created and that the processes and files are owned by the appropriate users (for example, HDFs and mapred users).

A) ssh-keygen-t RSA key generation

b) Cp/root/.ssh/id_rsa.pub/root/.ssh/authorized_keys

c) ssh-copy-id-i ~/.ssh/id_rsa.pub [email protected]:~/.ssh/authorized_keys Import the key into the Authorized_keys file

3) IPv6 must be disabled (effective after reboot).

A) vi/etc/modprobe.conf plus two strips

b) Alias net-pf-10 off

c) alias IPv6 off

d) Verify that disabling IPv6 is successful IP address list

4) Turn off the firewall. or open a specific port, too many ports, directly shut down the firewall.

A) Service iptables stop

b) Chkconfig iptables off

5) for RedHat and CentOS, the/etc/sysconfig/network file on each host must contain the host name that you set (or verify) for the host

6) Cloudera Manager and CDH use multiple user accounts and groups to complete tasks. The settings for user accounts and groups depend on the components that you choose to install. Do not delete these accounts or groups, and do not modify their permissions. Make sure that existing systems do not prevent these accounts and groups from working correctly.

7) Adjust the cluster time synchronization. Can do time server (NTP server)

8) Turn off SELinux (takes effect after reboot).

A) vi/etc/rc.local

b) Set selinux=disabled

9) Maximize the use of physical memory.

A) vi/etc/sysctl.conf add

b) vm.swappiness = 0

c) sysctl-p change takes effect

10) Close the "Transparent large page", which can cause significant performance issues.

A) perform echo never >/sys/kernel/mm/redhat_transparent_hugepage/defrag

b) Add the Execute command to the/etc/rc.local

1.3 Department

1. Download Execution Oudera-manager-installer.bin

http://www.cloudera.com/content/www/en-us/downloads/cdh/5-4-8.html Download URL

wget Http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin

chmod u+x Cloudera-manager-installer.bin

./cloudera-manager-installer.bin

2, then the next step, accept, etc., until the completion of execution.

3. Access http: 7108 page installation

4. Log in to Cloudera Manager Admin Console. Default credentials include: User name: admin password: admin. Cloudera Manager does not support changing the Admin user name of an installed account.

5. Select the Cloudera Manager version to install

6. Find the cluster host you specified by hostname and IP address range

7. Use SSH to connect to each host to install the Cloudera Manager Agent and other components

8. (optional) Install the Oracle JDK on the clustered host. If you choose not to install the JDK, you must install it on all clusters by following the official instructions before running the wizard

9. Provide SSH login credentials

10. Start the installation

11, download CDH Parcel, this is relatively large, about 1.5G

12, check the correctness of the host, if there is a problem, follow the check prompt to solve (according to my pre-deployment preparation, there will be no problem).

13, select the services to be installed, select all services can also be customized services, their own test to build a small memory, you can choose the core Hadoop

14. Set up the database and test the connection

15, the cluster settings, mostly are some directory settings, the default can be

16. First start

Installation is complete!

17, after the installation is complete, there will be some errors, follow the instructions to modify the configuration can be (some do not affect the use).

Cloudera Manager5 and CDH5 Online (cloudera-manager-installer.bin) installation Detailed documentation