Use Cloudera Manager to install Hadoop
Hadoop is composed of many different services (such as HDFS, Hive, HBase, Spark, and so on). These services also have some dependencies. If you directly download the original Apache package, it is troublesome to download multiple times and configure multiple times. As a result, some companies have customized Hadoop, such as Cloudera,
1.1 DescriptionCDH official installation Deployment documentation, and step detailsHttp://www.cloudera.com/content/cloudera/zh-CN/documentation/core/v5-3-x/topics/installation_installation.htmlHere is the first way Cloudera Manager installs automaticallyCloudera Manager 5 requirements and supported versions specific detailsHttp://www.cloudera.com/content/cloudera
Hadoop Foundation----Hadoop Combat (vi)-----HADOOP management Tools---Cloudera Manager---CDH introduction
We have already learned about CDH in the last article, we will install CDH5.8 for the following study. CDH5.8 is now a relatively new version of Hadoop with more than hadoop2.0, and it already contains a number of components and components in the Hadoop ecosystem that we need to learn next.
Environment
Cl
Custom Hortonworks HDP Boot service can do this: the original source of this article: http://blog.csdn.net/bluishglc/article/details/42109253 prohibited any form of reprint, Otherwise will be commissioned CSDN official maintenance rights! Files found:/usr/lib/hue/tools/start_scripts/start_deps.mf,hortonworks HDP the command to start all services and components is in this file, The reason for these services
1. Download Ambari-impala-service
sudo git clone https://github.com/cas-bigdatalab/ambari-impala-service.git/var/lib/ambari-server/resources/stacks /hdp/2.4/services/impala
2./ETC/YUM.REPOS.D New Impala.repo
[Cloudera-cdh5]
# Packages for Cloudera's distribution for Hadoop, Version 5, on RedHat or CentOS 7 x86_64
Name=cloudera ' s distribution for Hadoop, Version 5
baseurl=https://archive.cloudera.com/c
.hortonworks.com/hdp-gpl/centos7/3.x/updates/3.0.0.0/hdp.gpl.repoTarball MD5 | Asc:http://public-repo-1.hortonworks.com/hdp-gpl/centos7/3.x/updates/3.0.0.0/hdp-gpl-3.0.0.0-centos7-gpl.tar.gz
Second, configure the server1, install the necessary dependence:Yum-y install net-tools vim NTP bzip2 gcc readline-devel zlib-devel httpd wget2. Configure the/etc/hosts file for each server: Add the following 3 lines to it
192.168.0.105 chavin.king Chavin192.168.0.107 chavin02.king
This document is suitable for all versions of Cloudera Manager 5 and is upgraded using Tarballs tarballs contains Cloudera Manager server and Cloudera manageragent.
Https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ag_ug_cm5_tarballs.html#cm_ag_ug_cm5_tarballs
In most scenarios, upgrading Cloudera Man
Clouderacloudera Company mainly provides Apache Hadoop Development Engineer Certification (Cloudera certifieddeveloper for Apache Hadoop, CCDH) and ApacheFor more information about the Hadoop Management Engineer certification (Cloudera certifiedadministrator for Apache Hadoop, Ccah), please refer to the Cloudera company's official website. The Hortonworkshortonwo
In the latest release of the Hortonworks HDP Sandbox version 2.2, HBase starts with an error, because the new version of HBase's storage path is different from the past, and the startup script still inherits the old command line to start HBase, The hbase-daemond.sh file could not be found and failed to start. See, the 2.2 version of the sandbox release a little hasty, so obvious and simple mistakes should not appear. Here's how to fix the problem:The
Recently engaged in the installation of Cloudera Manager, experienced a lot of frustrations, summed up:
Also referred to a number of other people's posts such as:
http://blog.csdn.net/a921122/article/details/51939692
Http://www.aboutyun.com/forum.php?mod=viewthreadtid=9086extra=page%3D1
http://www.aboutyun.com/forum.php?mod=viewthreadtid=10852highlight=%C0%EB%CF%DF%B0%B2%D7%B0Cloudera% 2BManager
The approximate method is feasible. System Environment4
Create a cloudera-SCM user (with a branch, This is a Linux Command ,)
[[emailprotected]cloudera-manager-5.1.0]$sudouseradd--system--home=/opt/cloudera-manager-5.1.0/run/cloudera-scm-server--no-create-home--shell=/bin/false--comment"ClouderaSCMUser"cloudera-scm
Change server_
Cloudera Manager and CDH 5.14.0 Installation Process in CentOS 7
As we all know, the configuration of Apache Hadoop is cumbersome and fragmented. For this reason, Cloudera provides the Clouder Manager tool and encapsulates Apache Hadoop, flume, spark, hive, hbase and other big data products form CDH products with their own characteristics, and then use CM for installation. This facilitates cluster construct
local Yum software source installation Cloudera Manager 5
Cloudera Manager 5 (hereinafter referred to as cm) by default online installation, to the Internet or network is not easy to bring users inconvenience, due to network problems, repeated failure of the frustration, so that the first learning CDH users really experience the beginning of everything difficult. This article explains that in the CentOS
The Hadoop installation in this article is based on the Hortonworks RPMs installation
Documents See: Http://docs.hortonworks.com/CURRENT/index.htm
Http://www.oracle.com/technetwork/java/javase/downloads/jdk-6u31-download-1501634.html
Download Java jdk-6u31-linux-x64.bin
#Java settings
chmod U+x/home/jdk-6u31-linux-x64.bin
/home/jdk-6u31-linux-x64.bin-noregister
MV jdk1.6.0_31/usr/
#Create Symbolic Links (symlinks) to the JDK.
Mkdir/usr/java
Provider are required for any authorization system. Therefore, they are public modules and can serve other query engines in the future.5. Summary
Fine-grained access control on the big data platform is being implemented. Of course, the platform vendors are dominated by Cloudera and Hortonworks. Cloudera focuses on the Sentry authorization system; on the one hand
http://site.clairvoyantsoft.com/migrate-cloudera-scm-database-from-postgresql-to-mysql/
http://node0:7180/api/v14/cm/deployment--– the correct URL. 1. Discontinue service;
1. In the UI interface, stop the cluster;
2. In the UI interface, stop all services such as CM service,monitor;
3. In Linux, stop Agent service: Service cloudera-scm-agent stop
2. Backup cm configuration, via api--
$ curl-v-u admin:adm
or download the Word document: http://download.csdn.net/download/xfg0218/9747346
about CDH and Cloudera Manager
CDH (Cloudera's distribution, including Apache Hadoop), is one of the many branches of Hadoop, built from Cloudera maintenance, based on the stable version of Apache Hadoop, and integrates many patches, Can be used directly in production environments.
Cloud
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.