cdh installation

cm UpgradeOperation Dimension: Root Unified password do not mistakenly delete cluster backup file login Cmserver installed host, execute command: cat/etc/cloudera-scm-server/db.properties login PostgreSQL database psql-u scm-p 7 432 input Password: Back up cm Data: pg_dump-h cdhmaster-p 7432-u SCM >/tmp/scm_server_db_backup.$ (date +%y%m%d) Check/tmp for file generation, period guarantee TM P under file should not be deleted. Stop it Impala Hue Hive ServiceStop cm Server:sudo service cloudera-sc

Recent projects need to use Oozie Workflow scheduling hivesql, found unable to execute query statements, see: https://community.cloudera.com/t5/Batch-Processing-and-Workflow/ oozie-hive-action-failed-with-wrong-tmp-path/td-p/37443 this, the culprit is CDH bug, need to upgrade the version.Upgrade steps:1. Querying a service on a single nodeService--status-allFound only cloudera-scm-agent, no cloudera-scm-server, indicating that this is not the primary

Encounter a problem, because the default is to install CDH System/var/log directory, because it is a virtual instance, the system disk smaller only 50G, is the use of the system cm will be alerted to the alarm log directory space is not enough, if the script is deleted periodically, although it can solve the current problem, but not a good way. The other is to directly modify the configuration file, all the/var/log/* manually changed to/home/var/log/*

/local/lib6. Installing and configuring HadoopMaster and slaveTar zxvf hadoop-2.5.0-cdh5.4.8.tar.gzmv hadoop-2.5.0-cdh5.4.8/usr/hadoopcd/usr/hadoopmkdir-p tmpcd/usr/hadoop/mv Bi N bin-mapreduce2/ln-s Bin-mapreduce1 binmv example Example-mapreduce2 ln-s example-mapreduce1 examplecd etc/mv Hadoo P Hadoop-mapreduce2ln-s Hadoop-mapreduce1 Hadoop7. Add a Hadoop environment variableVim/etc/profile Export Hadoop_home=/usr/hadoop export path= $PATH: $HADOOP _home: $HADOOP _home/binsource/etc/profile8. G

I have been using phphiveadmin and have been paying attention to Hue. I plan to investigate hue recently. Hue has developed rapidly in the last two years, and the page effects and functions have been greatly improved, more and more services are supported. Besides hive and hbase, sqoop, impala, and pig are also supported. Shows a general hue architecture. 650) This. width = 650; "src =" http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/4.2.0/CDH4-

CM Add hive Service after installing CDH, error message appearsWhen adding a service, hive is configured as follows: Error message: Error log:Xec/opt/cloudera/parcels/cdh-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop/bin/hadoop jar/opt/cloudera/parcels/ Cdh-5.4.7-1.cdh5.4.7.p0.3/lib/hive/lib/hive-cli-1.1.0-cdh5.4.7.jar Org.apache.hive.beeline.HiveSchemaTool- Verbose-dbtype My

1. Create the lib121 directory under the hive0.13.1 version Cd/opt/cloudera/parcels/cdh/lib/hive;mkdir lib1212. Download the hive1.2.1 version and copy all files from this version of Lib to lib121 3. Modify the Hive_lib variable in/opt/cloudera/parcels/cdh/lib/hive/bin/hive hive_lib=${hive_home}/lib121 4. Update the JLine jar package on Hadoop and remove the old Jlien jar package RM-RF Jline-0.9.94.jar

I. risks are classified into internal and externalFirst, internal:During the deployment of CDH Big Data clusters, users named after services are automatically created,Username (login_name): Password location (passwd): User ID (UID): User Group ID (GID): annotation description (users): Home directory ): log on to Shell)CAT/etc/shadowThe format of the second column in the shadow file. It is the encrypted password. This column is "!! ", That is ":!! : ",

We know that Namenode's single-machine failure is cumbersome, and CDH offers high-availability options.The operation is as follows:Click on "HDFS"Select NamenodeClick "Action" and select:Set your own name.Click "Continue"Click "Continue"This keeps the default and then continues with the problemReturn, write a valueGo onIndicates that the operation is being processed,Start successfully!Go back and look at the Overview interface:You can see that Seconda

."s/eth1/eth0/g"$net _rule_fileElseNew_mac_str=$(sed-n-e'/eth0/p'$net _rule_file) #new_mac_1=${NEW_MAC_STR: -: -} New_mac=$(Echo$new _mac_str|awk-F','{'Print $4'}|awk-F'=='{'Print $'}|sed 's/\ "//g') Echo "Done 70-persistent-net.rules file!"fi#===================================#将新的网络配置入写网卡文件, restart the networkif(Cat$net _conf_file|grep$netmask _conf); Then Echo "Done/etc/sysconfig/network-scripts/ifcfg-eth0"elif[!-N" $"] ; Then Echo "You had not input a IP address!"Else sed-I."/$old _ma