CDH5.2.0 Upgrade to CDH5.3.3

The company has a spark on yarn cluster, built based on cm5.2.0+cdh5.2.0, and the version of Spark is 1.1.0. To use some of the features of Spark1.2.0, decide to upgrade the cluster version to cm5.3.3+cdh5.3.3. CM is upgraded because the version number of CM must be greater than or equal to the version number of CDH. The following two steps describe the upgrade process: CM Upgrade and CDH upgrade.

1 cm Upgrade Process Introduction

1.1 Admin User Login Http://10.10.244.137:7180/cmf/home, turn off Cluster service and Cloudera Management Service

1.2 Through the Click service----"click Command----" running command, recent command, confirm 1.1 operation succeeded

1.3 Shut down the agent on each host. Shut down the server on the host where CM server is located, and if you use a database that comes with CM, close the database

Sudoservice cloudera-scm-agent stop;sudoservice cloudera-scm-server Stop; sudo service cloudera-scm-server-db stop (show "If not Started"service cannot be found",If you see theThe shutdown failed",indicates that the database is in use);

1.4 Upgrading Cloudera Manager Server Packages

Configure the Yum source---" execute sudo yumclean all;sudoyum upgrade ' cloudera-* '; verify rpm- QA ' cloudera-manager-* '

1.5 Starting Cloudera Manager Server

sudoservice cloudera-scm-server Start ;

1.6 Update Cloudera manager Agent Packages

sudoservice cloudera-scm-agent Stop;Cloudera Manager installs Agent software----"No, I would like to skip the agent upgrade Nowand click Continue----"ConfigurationYumSource----"sudo yum clean all;Sudoyum upgrade ' cloudera-* ';sudo service cloudera-scm-agent start;

1.7 Checking for updated results

     7180 home ---- " host ---- " host inspector

1.8 Start all the services

1.9 Deployment of Client Configuration

7,180 first----"Deploy Client Configuration"

2 CDH Upgrade Process Introduction

2.1 Upgrading CDH's Packages

Close all services----Configure Yum source----sudo yum clean all;sudo yum update (update all CDH packages)

2.2 Update the symbolic link to point to the latest installed CDH components

sudo cloudera-scm-agent restart

2.3 Backing up Namenode metadata and DB data

HDFS----"Configuration-----" NameNode data directory, backup;

DB Backup Example: Mysqldump-uroot-h10.10.244.137-p rman>/home/cloudera/sql-copy/rman.sql

2.4 Performing the Update Wizard

          Login to 7180 home ---- click clustername next to the button ---->upgrade Cluster---->choose Method select use Packages---- choose CDH Version select CDH ----

CDH5.2.0 upgrade to CDH5.3.3