1. Basic Environment Preparation
[[email protected] html]$ sudo chkconfig iptables off disable firewall
[Email protected] html]$ Vi/etc/selinux/configDisable selinux,selinux=disabled
Note: Save reboot system
2, Cloudera Manager's offline installation package download, build cm local source
[Email protected] html]$ pwd
/var/www/html
[Email protected] html]$ tree
--CM5
'--Redhat
'--6
'--x86_64
'--cm
|--5
| |--Mirrors
| |--Repodata
| | |--filelists.xml.gz
| | |--FILELISTS.XML.GZ.ASC
| | |--other.xml.gz
| | |--OTHER.XML.GZ.ASC
| | |--primary.xml.gz
| | |--PRIMARY.XML.GZ.ASC
| | |--Repomd.xml
| | '--REPOMD.XML.ASC
| '--RPMS
| |--Noarch
| '--x86_64
| |--cloudera-manager-agent-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| |--cloudera-manager-daemons-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| |--cloudera-manager-server-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| |--cloudera-manager-server-db-2-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| |--enterprise-debuginfo-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| |--jdk-6u31-linux-amd64.rpm
| '--oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
|--Cloudera-manager.repo
'--Rpm-gpg-key-cloudera
Ten directories, files
Note: To deploy CDH in the production system, first to implement the Cloudera Manager offline installation, install Cloudera Manager, but also through the Cloudera Manager to perform CDH offline installation two steps. Due to the closeness of the production environment and the domestic network environment, these offline packages are difficult to download from Cloudera's official website, so it is necessary to map Cloudera's official website to the local IP.
3. Configuring an HTTP Service
[[email protected] html]$ sudo/etc/init.d/httpd startStart the httpd service
[[email protected] html]$ chkconfig--list httpd check httpd service boot start condition
[Email protected] html]$ Ps-ef|grep ApacheSee if this service is started
Note: We put the required package for CM installation under this service directory.
4. Configure local mapping IP to this httpd service
[Email protected] html]$ cat/etc/hosts
192.168.2.200 Server1
192.168.2.201 Server2
192.168.2.202 Server3
192.168.2.203 Server4
192.168.2.124 archive.cloudera.com
192.168.2.124 archive-primary.cloudera.com
http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/The local machine to enter this address to access the local source library you built
Note: Note that the map address is configured on all machines to follow CDH, if you want to verify whether everyone offline source is successful, please install the source address in the Windows local Hosts file map, the browser address can be verified.
5, CDH and Impala offline installation package download
[email protected] html]$ sudo mkdir cdh5/parcels/latest-pCreate source Directory
[Email protected] html]$ tree/var/www/html/
/var/www/html/
|--Cdh5
| '--parcels
| '--Latest
| |--Cdh-5.3.0-1.cdh5.3.0.p0.30-el5.parcel
| |--Cdh-5.3.0-1.cdh5.3.0.p0.30-el6.parcel
| |--Cdh-5.3.0-1.cdh5.3.0.p0.30-precise.parcel
| |--Cdh-5.3.0-1.cdh5.3.0.p0.30-sles11.parcel
| |--Cdh-5.3.0-1.cdh5.3.0.p0.30-trusty.parcel
| |--Cdh-5.3.0-1.cdh5.3.0.p0.30-wheezy.parcel
| '--Manifest.json
'--CM5
'--Redhat
'--6
'--x86_64
'--cm
|--5
| |--RPMS
| | |--Noarch
| | '--x86_64
| | |--cloudera-manager-agent-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| | |--cloudera-manager-daemons-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| | |--cloudera-manager-server-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| | |--cloudera-manager-server-db-2-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| | |--enterprise-debuginfo-5.3.0-1.cm530.p0.166.el6.x86_64.rpm
| | |--jdk-6u31-linux-amd64.rpm
| | '--oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
| |--Mirrors
| '--Repodata
| |--filelists.xml.gz
| |--FILELISTS.XML.GZ.ASC
| |--other.xml.gz
| |--OTHER.XML.GZ.ASC
| |--primary.xml.gz
| |--PRIMARY.XML.GZ.ASC
| |--Repomd.xml
| '--REPOMD.XML.ASC
|--Rpm-gpg-key-cloudera
'--Cloudera-manager.repo
6. Install the software you want
Rpm-qa | grep MySQLCheck if MySQL is installed
117 Rpm-e mysql-libs-5.1.71-1.el6.x86_64 Unloading
118 Rpm-e mysql-libs-5.1.71-1.el6.x86_64--nodeps forced uninstallation
119 Rpm-qa | grep MySQLCheck whether to uninstall
Rpm-i mysql-server-5.5.40-1.linux2.6.x86_64.rpm Install MySQL
121 Mysqld_safe &Start the MySQL server
122 Rpm-i mysql-client-5.5.40-1.linux2.6.x86_64.rpm Installing the Client
123 mysql_secure_installation Change Password and initialization information
124 Mysql-uroot-padminLogin
126 TAR-ZXVF Jdk-7u45-linux-x64.tar.gz-c. /install JDK
143 chmod u+x Cloudera-manager-installer.bin Modify permissions to Executable
145./cloudera-manager-installer.bin Install cm
[Email protected] installpackage]# CAT/VAR/LOG/CLOUDERA-MANAGER-INSTALLER/4. Install-cloudera-manager-server-db-2.log
Installation Error: error:package:cloudera-manager-server-db-2-5.0.0-1.cm500.p0.215.el6.x86_64 (Cloudera-manager)
Requires:postgresql-server >= 8.4
Workaround: Manually download the rpm files and install them sequentially, as CM relies on the PostgreSQL database.
RPM-IVH postgresql-libs-8.4.20-1.el6_5.x86_64.rpm
RPM-IVH postgresql-8.4.20-1.el6_5.x86_64.rpm
RPM-IVH postgresql-server-8.4.20-1.el6_5.x86_64.rpm
[Email protected] installpackage]#./cloudera-manager-installer.binInstall again to succeed
[Email protected] installpackage]# Netstat-an | grep 7180See if Port 7180 is up
TCP 0 0 0.0.0.0:7180 0.0.0.0:* LISTEN
TCP 0 0 135.32.43.192:7180 135.32.43.209:63901 time_wait
TCP 0 0 135.32.43.192:7180 135.32.43.209:63902 time_wait
TCP 0 0 135.32.43.192:7180 135.32.43.209:63899 time_wait
TCP 0 0 135.32.43.192:7180 135.32.43.209:63895 time_wait
7, install CM process error
--Finished Dependency Resolution
Error:package:cloudera-manager-agent-5.3.0-1.cm530.p0.166.el6.x86_64 (Cloudera-manager)
Requires:fuse-libs
Error:package:cloudera-manager-agent-5.3.0-1.cm530.p0.166.el6.x86_64 (Cloudera-manager)
Requires:redhat-lsb
Error:package:cloudera-manager-agent-5.3.0-1.cm530.p0.166.el6.x86_64 (Cloudera-manager)
Requires:cyrus-sasl-gssapi
Error:package:cloudera-manager-agent-5.3.0-1.cm530.p0.166.el6.x86_64 (Cloudera-manager)
Requires:portmap
Error:package:cloudera-manager-agent-5.3.0-1.cm530.p0.166.el6.x86_64 (Cloudera-manager)
Requires:fuse
You could try using--skip-broken to work around the problem
You could try Running:rpm-va--nofiles--nodigest
END (1)
Remote Package cloudera-manager-agent could is installed, giving up waiting for rollback request
For domestic sources, install sudo yum installation redhat-lsb-y, sudo yum install-y cyrus-sasl-gssapi portmap,sudo yum install fuse-libs fuse
$ Vi/etc/yum.repos.d/163.repo #如果没有这个文件, create a new one, remember: $releasever modified to 6
[Base]
name=centos-$releasever-base-163.com
baseurl=http://mirrors.163.com/centos/6/os/$basearch/
Enabled=1
Gpgcheck=0
[Updates]
name=centos-$releasever-updates-163.com
baseurl=http://mirrors.163.com/centos/6/updates/$basearch/
Enabled=1
Gpgcheck=0
[Extras]
name=centos-$releasever-extras-163.com
baseurl=http://mirrors.163.com/centos/6/extras/$basearch/
Enabled=1
Gpgcheck=0
[email protected] yum.repos.d]# Yum Clean all
[email protected] yum.repos.d]# Yum Makecache #生成缓存
[email protected] yum.repos.d]# Yum install redhat-lsb cyrus-sasl-gssapi portmap fuse-libs fuse-y
At this point, cm offline installation is complete!
Note: If you and I are built with a laptop virtual machine, there may be insufficient memory, causing CM to hang up please restart cm service,/etc/init.d/cloudera-scm-server start,/etc/init.d/ Cloudera-scm-agent start, have to admire, Cloudera powerful, after you start the CM service, the file continues to start distributing breakpoints! Without having to start over again.
8. Adding various Hadoop components to the CM interface
Note: If the component is offline, please put the Cloudera related project source directory structure and RPM package installed before the CM installation of the local source mode storage RPM package, here to successfully install the components!
Cloudera-manager-installaction
