Upgrade CDH5.2.0 to CDH5.3.3 and cdh5.2.0cdh5.3.3

Upgrade CDH5.2.0 to CDH5.3.3 and cdh5.2.0cdh5.3.3

The company has a Spark on Yarn cluster, which is built based on CM5.2.0 + CDH5.2.0 and the Spark version is 1.1.0. To use some features of Spark1.2.0, we decided to upgrade the cluster version to CM5.3.3 + CDH5.3.3. The reason for CM upgrade is that the version number of CM must be greater than or equal to the version number of CDH. The following two steps describe the upgrade process: CM upgrade and CDH upgrade.

1 CM upgrade process Introduction

1.1 log on to http: // 10.10.244.loud: 7180/cmf/home, and disable the cluster service and Cloudera management service.

1.2 run the "click Service ----" click Command ---- "and the latest command to confirm that operation 1.1 is successful.

1.3 disable the agent on each host. Disable the Server on the host where CM server is located. If the built-in database of CM is used, disable the database.

Sudoservice cloudera-scm-agent stop; sudoservice cloudera-scm-server stop; sudo service cloudera-scm-server-db stop (if not started, "service cannot be found" is displayed ", if "the shutdown failed" is displayed, the database is in use );

1.4 upgrade Cloudera Manager Server Packages

Configure YUM source --- run sudo yum clean all; sudoyum upgrade 'cloudera-* '; Verify rpm-qa 'cloudera-manager -*'

1.5 start Cloudera Manager Server

Sudoservice cloudera-scm-server start;

1.6 Update the Cloudera manager Agent Packages

Sudoservice cloudera-scm-agent stop; Cloudera Manager installagent software ---- "No, I wowould like to skip the Agent upgrade nowand click Continue ----" configure yum source ---- "sudo yum clean all; sudoyum upgrade 'cloudera-* '; sudo service cloudera-scm-agent start;

1.7 check update results

7180 homepage ---- Host Inspector

1.8 start all services

1.9 deploy client Configuration

7180 homepage ---- Deploy Client Configuration

2 CDH upgrade process Introduction

 2.1 upgrade CDH Packages

Disable all services ---- configure Yum source ---- sudo yum clean all; sudo yum update (update all CDH packages)

2.2 update the symbolic link to point to the latest installed CDH component

Sudo cloudera-scm-agent restart

2.3 back up namenode metadata and DB data

HDFS ---- configuration ----- NameNode Data Directory, which is backed up;

DB Backup example: mysqldump-uroot-h10.244.20.- p rman>/home/cloudera/SQL-copy/rman. SQL

2.4 run the Update Wizard

Log on to the 7180 homepage ---- "and click the button next to clustername ----> Upgrade Cluster ----> Choose Method select Use Packages ----" Choose CDH Version select CDH Version ---- ".