CDH Version Upgrade

Recent projects need to use Oozie Workflow scheduling hivesql, found unable to execute query statements, see: https://community.cloudera.com/t5/Batch-Processing-and-Workflow/ oozie-hive-action-failed-with-wrong-tmp-path/td-p/37443 this, the culprit is CDH bug, need to upgrade the version.

Upgrade steps:

1. Querying a service on a single node

Service--status-all

Found only cloudera-scm-agent, no cloudera-scm-server, indicating that this is not the primary node.

2. View Cloudera's master node

Cat /etc/cloudera-scm-agent/config.ini

Find the value of the Server_host, which is the primary node of the server-side installation and log on on the primary node.

3. View cm-dependent databases

Cat /etc/cloudera-scm-server/db.properties

4. Backup cm data

Pg_dump-u scm-p 7432 > Scm_server_db_backup.bak

Where SCM is dependent on the database name, the password is shown in step 3rd of the results. Check if there is a file generation under/TMP and ensure that the file is not deleted under TMP.

5. Stop cm Server:

sudo service cloudera-scm-server stop

To stop the database that the CM server relies on:

sudo service cloudera-scm-server-db stop

If the agent on this CM server is running also stops:

sudo service cloudera-scm-agent stop

Where the CLOUDERA-SCM-SERVER-DB service stopped failing and the query service status was found as follows:

Pg_ctl:server is running (pid:1713)
/usr/bin/postgres "-D" "/var/lib/cloudera-scm-server-db/data"

cd/var/lib/cloudera-scm-server-db/DataRM Postmaster.pid

http://blog.puneethabm.in/cloudera-scm-server-db-pg_ctl-server-does-not-shut-down/

6. To view Yum's Cloudera-manager.repo files need not be modified

sudo vim/etc/yum. Repos.d/cloudera-manager.repo

Find Cloudera-manager version Newer and do not need to upgrade Cloudera-manager

7. Upgrade

Check:

RPM  'cloudera-manager-*'

8. Start the CM server database:

sudo  Service Cloudera-scm-server-db Start

Failed to start!!

PS grep Bin/postgres

View the DB process and discover the existence of a cloudera-scm-server-db process

#kill-9 [PID]

Kill and restart the service, OK

To start the CM server:

sudo  Service Cloudera-scm-server Start

To start the CM Agent:

sudo  Service Cloudera-scm-agent Start

Finally, re-use Oozie to tune Hive, execute success!!

Reference:

http://www.tuicool.com/articles/YVnu6v

Http://www.aboutyun.com/thread-10856-1-1.html

CDH Version Upgrade