I. Related software preparation and planning
1, related software and download address:
Cloudera manager:http://archive-primary.cloudera.com/cm5/cm/5/CDH installation package Address: http://archive.cloudera.com/cdh5/parcels/latest/Java Official Download (login required): http://www.oracle.com/technetwork/java/archive-139210.htmlJava versions archive Download (no login required): https://www.reucon.com/cdn/java/MySQL JDBC driver jar pack: http://dev.
Label: cloudera
For partition consideration, do not use LVMRoot --> 40 GB
VaR --> 100 GB
Swap -- 2x system memory
Ram --> 8 GBMaster node:Raid 10, dual Ethernet cards, dual power supplies, etc.Slave node:1. Raid is not necessary
2. HDFS partition, not using LVM/Etc/fstab -- ext3 defaults, noatimeMount to/data/n/dfs/dn, for n = 0, 1, 2... (one partition per disk)
Cloudera CDH Repository:
Http://archive.clo
Cloudera Manager 5.3.2 and CDH5.3.2 environment Configuration
System Environment
9 DELL R720xd servers (192.168.3.245-253) and 1 r0000master node (192.168.3.243)NIC: 1000 MEach of the nine DELL R720xd servers has 12x4 TB disks.Network Environment IntranetCentOS6.6 x64 (Final)
1. Prepare for uninstallation system comes with OPEN-JDK (all nodes)The installed Centos system sometimes automatically installs Open
Original articles, reproduced please specify: Reproduced from http://www.cnblogs.com/tovin/p/4689422.htmlThis article describes the installation steps for CM5.4 in CentOS 6I. Building a yum Warehouse1, build a Web server, the specific steps omitted2, download cm, CDH parcels bagDownload cm RPM Package: wget-r-L-NP http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.4/Download CDH Parcels Package: Wget-r-L-NP http://archive.cloudera.com/cdh5/parcels/5.4/(note: Download the corresponding version
Offline installation of Cloudera Manager Express--------------------------------# # #一, Installation Prerequisites # # #1. IP Address arrangement:#cat/etc/hosts222.31.101.11cdh5-nn1222.31.101.13cdh5-dn1222.31.101.14cdh5-dn2222.31.101.16Cdh5-dn3# # #二, installation steps # # #1. Turn off the firewall and set the boot to no bootService Iptables StopChkconfig iptables off2. Set SELinux to Disabled#cat/etc/sysc
Uninstall cloudera-Manager
sudo /usr/share/cmf/uninstall-cloudera-manager.sh
Always select Yes
After the uninstallation is complete, it will ask you if you want to clean up the data in the database, select Yes
2. Delete the installation directory of cloudera according to the official introduction.
sudo rm -rf /usr/shar
Objectives:
I used cloudera Manager server to install and manage hadoop clusters. I heard that general enterprises use cloudera to install and manage hadoop. I also want to try it. I checked the data for a day and found that cloudera is very mature, in addition, the installation methods of pseudo do distributed and
Upgrade Cloudera Manager to 5.2.11. Stop the Cloudera Management Service2. Stop The hive service and all services such as Impala and Hue this use the hive Metastore.3. Backup MySQL Databases (mysqldump-uroot-p--single-transaction--flush-logs--master-data=2--delete-master-logs--a ll-databases > Backup.sql)4. Service Cloudera
insideLet's modify the hostTwo comments out of the front.6. Configure the Yum source6.1 Copying filesDelete the repo file that comes with the system in the/ETC/YUM.REPOS.D directory firstWill: Create a new file: Cloudera-manager.repoTouch Cloudera-manager.repoThe contents of the file are:BaseURL back is the folder inside your var/www/html.baseurl=http://Correct the second time you do itThird Amendment[
Document directory
1) An error occurred while executing cloudera-Manager-install.
2) errors reported during JDK Installation
3) unable to start cloudera manager agent
4) The installation of parcel has never responded (more than 1 hour)
5) unable to start hive
Directory
I. Problems Encountered during installa
[Hadoop] 5. cloudera manager (3) and hadoopcloudera installed on HadoopInstall
Http://blog.sina.com.cn/s/blog_75262f0b0101aeuo.html
Before that, install all the files in the cm package
This is because CM depends on postgresql and requires postgresql to be installed on the local machine. If it is installed online, it is automatically installed in Yum mode. Because it is offline, postgresql cannot be inst
.el6.noarch.rpm/download/# Createrepo.When installing Createrepo here is unsuccessful, we put the front in Yum.repo. Delete something to restoreUseyum-y Installcreaterepo Installation TestFailedAnd then we're on the DVD. It says three copies of the installed files to the virtual machine.Install deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm FirstError:Download the appropriate rpmhttp://pkgs.org/centos-7/centos-x86_64/zlib-1.2.7-13.el7.i686.rpm/download/Http://pkgs.org/centos-7/centos-x86_64/glibc-2
Landing on the Cloudera manager found that a lot of the newspaper space, hand-cheap will be all deleted/tmp directory, and then restart the server and agent, found that the agent can start normally, but the server does not normally start, view log, found the error
2018-02-23 11:13:05,313 ERRORmain:com.cloudera.enterprise.dbutil.DbUtil:InnoDB engine not found. Showengines reported: [Mrg_myisam, CSV, MYISAM,
Why reboot:Suddenly found Clouderamanager's WebUI can't visit ...I used netstat to look at my WebUI listening port, found that more than close_wait, on-line check is the socket closed there is a problem caused by n multiple hang links.Reasons and how to resolve:Looking for a long, did not find a good way, had to restart the CDM to solve. If you have a better way, please leave a message ha.To restart the script:/opt/cloudera-
Original address: http://blog.csdn.net/a921122/article/details/51939692
File Download
CDH (Cloudera's distribution, including Apache Hadoop), is one of the many branches of Hadoop, built from Cloudera maintenance, based on the stable version of Apache Hadoop, and integrates many patches, Can be used directly in production environments.Cloudera Manager simplifies the installation and configuration managem
Hive Permissions configuration under Cloudera ManagerTags: Big data Hive permissions 2016-09-05 11:11 138 people read reviews (0) Favorite Report Category: Lot size: Hive/spark/hbas (58)
Directory (?) [+]
Company operations, BI, and different departments of finance different personnel need hive data query service, so need to assign different permissions to the relevant people
Permissions are configured to cover two main items:
-Authentication (authent
Display: An internal error occurred while querying Service Monitor (Error sending messages to firehose:mgmt-servicemonitor-)1. Initial row detection is Smon service port 9999 and Firehose Port 9998 is not availableNo, it's normal.2. Debug Web (the node where the Activity_monitor service resides) on port 8087 (default)I can't see the reason.3. Go to the Service Monitor node and look at the following: Obviously Java heap settings are small, so you need to increase the Java heap settingsCloudera
Resource Manager(Resource Manager)
? Report system resource usage? Develop capacity expansion plan
Authorization Manager(Authorization Manager)
? Centralized management of users, user groups, and permissions? Permission management through authorization
Service and Configuration
1. Cloudera IntroductionHadoop is an open source project that Cloudera Hadoop, simplifies the installation process, and provides some encapsulation of Hadoop.Depending on the needs of the Hadoop cluster to install a lot of components, one installation is more difficult to configure, but also consider ha, monitoring and so on.With Cloudera, you can easily deploy c
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.