CDH5 installation Brief steps

Source: Internet
Author: User
Tags scp file

    1. Modify Host


[Email protected] tmp]# cat/etc/hosts

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4

:: 1 localhost localhost.localdomain localhost6 localhost6.localdomain6

192.168.16.104 HADOOP1

[Email protected] tmp]#


[Email protected] tmp]# cat/etc/sysconfig/network

Networking=yes

Hostname=hadoop1

2. Free key to SSH, set SSH login without password (all nodes)


Execute the ssh-keygen-t RSA All-way return on the master node to generate a key pair without a password.


Add the public key to the authentication file: Cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys, and set the access rights for Authorized_keys: chmod ~/.ssh/ Authorized_keys.


SCP file to all Datenode nodes:


SCP ~/.ssh/authorized_keys [Email protected]:~/.ssh/



3.java Environment variables


Vi/etc/profile


To set the Hadoop environment variable:

Export JAVA_HOME=/USR/J2SDK

Export path=.: $JAVA _home/bin: $PATH


Source/etc/profile



4.yum install MySQL mysql-server-y

Chkconfig mysqld on

Set Password:

Mysqladmin-uroot Password 123456

Create DATABASE (On Demand):

#hive

Create DATABASE hive DEFAULT CHARSET UTF8 COLLATE utf8_general_ci;

#activity Monitor

Create database Amon DEFAULT CHARSET UTF8 COLLATE utf8_general_ci;


Initializing the CM database


/opt/cm-5. x.x/share/cmf/schema/scm_prepare_database.sh MySQL cm-hlocalhost-uroot-pxxxx--scm-host localhost SCM SCM


#授权root用户在主节点拥有所有数据库的访问权限

Grant all privileges on *. * to ' root ' @ ' * ' identified by ' Aptech ' with GRANT option;

Flush privileges;





5.yum Install Ntp-y


Master node: Sync time: Ntdate-u 65.55.56.206


Service NTPD Start


From the node configuration:

Driftfile/var/lib/ntp/drift

Restrict 127.0.0.1

Restrict-6:: 1

Restrict default Kod nomodify notrap nopeer noquery

restrict-6 default Kod nomodify notrap nopeer noquery

Server 192.168.16.104

Includefile/etc/ntp/crypto/pw

Keys/etc/ntp/keys


Chkconfig ntpd on


6. Unzip Cloudera-manager-el6-cm5.3.2_x86_64.tar to/opt create system user



Useradd--system--home=/opt/cm-5. x.x/run/cloudera-scm-server/--no-create-home--shell=/bin/false--comment "Cloudera SCM User" CLOUDERA-SCM


mysql-connector-java-5.1.30.tar.gz, unzip, find Mysql-connector-java-5.1.30-bin.jar and put it in/opt/cm-5.0.0/share/cmf/lib/directory.


7. Start the service

/opt/cm-5.0.0/etc/init.d/cloudera-scm-server start



8. The Client service program CP to the client

Scp-r/opt/cm-5.0.0 [Email protected]:/opt/cm-5.0.0


9. Installing CDH5

First download to the local http://archive-primary.cloudera.com/cdh5/parcels/5.0.0/, here need to download two things, the first is the corresponding to their own system version of the parcel package, Then the Manifest.json file. After the download is complete, put these two files in the master node/opt/cloudera/parcel-repo (directory installed Cloudera Manager 5 o'clock has been generated), note that the directory is not a word wrong, Next open the Manifest.json file and find the value corresponding to the last "hash".

Copy the value of "hash" and create a file with the name of your Parel package, plus the. sha suffix:

So your directory will have these 3 files, the "hash" of the value copied to the new Sha file, and save, OK, our local source production completed. This is basically done, and then the operation is the console follow the steps to install.


10. Open http://192.168.1.104:7180



Reference: http://www.aboutyun.com/thread-9086-1-1.html

Http://www.tuicool.com/articles/ENjmeaY


CDH5 installation Brief steps

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.