Oracle Upgrade PSU&OJVM experiencing problems

"Introduction to the Environment"

System environment: Solaris + Oracle 11R2 + OGG + Scripting timed task statistics collection

"Background description"

Based on group security checks, vulnerability scanning of database versions is required, vulnerabilities in RBDMS and JVM types exist in vulnerability scanning, and vulnerabilities need to be fixed by upgrading the small version of the PSU and OJVM. Here is an overview of the upgrade and the resolution of the problem.

"Problem Handling"

Upgrade generally in the evening operation, before upgrading the database to pay attention to the problem (due to a lot of script, here the script, if necessary script can leave a message):

Database software Backup in advance (can eliminate the AUD small files, backup small files Many cause backup time is very long, it is recommended to backup one day in advance), data Backup (database fully prepared);

Database parameter backup, after the completion of the project parameter comparison (historical reasons cause the Startup database Pfile file parameters caused by the host resource exhaustion or other problems);

Stop the database timing tasks (preventing large transactions from causing the database to stop having problems);

Stop database automatic statistics or manual script statistics collection (resulting in post-upgrade compilation cannot be done);

Stop other software operations on the database (OGG etc, ogg process card master);

Operating system space needs to be greater than 35G (if insufficient space can trigger a bug:

10131946 GRID Patches REQUIRE 22GB of free SPACE
12791141 PATCH 12311357:with 35GB free SPACE:ERROR:REQUIRED AMOUNT of SPACE
1088455.1 Opatch checksystemspace fails with Error Code, while applying GI PSU);

Operating system lang character problem (can trigger a bug, resulting in an upgrade error), it is recommended to use English characters by default;

Patch conflict (DB, some for one of the patch conflicts need to be rolled back before upgrade, GI), platform detection.

Before the operation of the database upgrade, check the database patch conflict again, platform detection, but the patch needs special . So file validation is checked after stopping the DB instance and is also a frequent problem with file occupancy.

Check Information:

[Email protected]:/opt/oracle/app/oracle_base/patch/26636028$ $ORACLE _home/opatch/opatch prereq Checkactivefilesandexecutables-phbasedir./26635745
Oracle Interim Patch Installer version 11.2.0.3.18
Copyright (c) 2018, Oracle Corporation. All rights reserved.

Prereq session

Oracle Home:/opt/oracle/app/grid_home
Central Inventory:/opt/oracle/app/orainventory
From:/opt/oracle/app/grid_home/orainst.loc
Opatch version:11.2.0.3.18
OUI version:11.2.0.4.0
Log File Location:/opt/oracle/app/grid_home/cfgtoollogs/opatch/opatch2018-04-27_01-50-50am_1.log

Invoking Prereq "Checkactivefilesandexecutables"

......

Prereq "Checkactivefilesandexecutables" for Patch 17478514 failed.

The details are:

Following executables is active:
/opt/oracle/app/grid_home/bin/oracle
/opt/oracle/app/grid_home/lib/libclntsh.so.11.1

Prereq "Checkactivefilesandexecutables" for Patch 18031668 passed.

.......

Prereq "Checkactivefilesandexecutables" for Patch 26392168 passed.

Opatch succeeded.

Omitting part of the content, you can see that the special file is checked when found to be occupied. See which process is consuming:

[Email protected]:/opt/oracle/app/oracle_base/patch/26636028$ fuser/opt/oracle/app/grid_home/lib/ libclntsh.so.11.1
/opt/oracle/app/grid_home/lib/libclntsh.so.11.1: 9465m 9447m 9331m 9210m 8889m 8750m 8578m 84 98m 8496m 8494m 8417m 8416m 8395m 21708m 8361m 8286m 8164m 14225m 14198m 14186m

However, there is a process, and the root user is occupied, the cluster cannot stop the process:

[Email protected]:/opt/oracle/app/oracle_base/patch/26636028# ps-ef |grep/opt/oracle/app/grid_home/jdk/bin/ Sparcv9/java
root 21708 4111 0 02:37:17 pts/1 0:00 grep /opt/oracle/app/grid_home/jdk/bin/sparcv9/java

Under normal circumstances, the bit grid users that occupy the file will stop these processes when the database is upgraded.

[Email protected] ~]$ fuser/u01/app/11.2.0/grid/lib/libclntsh.so.11.1
/u01/app/11.2.0/grid/lib/libclntsh.so.11.1:2400m 2411m 2422m 2432m 2491m 2623m 2837m 2885m 2887m 2984m 2985m 3029m 3046m

[Email protected] ~]$ ps-ef |egrep ' 2400|2411|2422|2432|2491|2623|2837|2885|2887|2984|2985|3029|3046 '
Grid 2400 1 0 10:48? 00:00:00/u01/app/11.2.0/grid/bin/oraagent.bin
Grid 2411 1 0 10:48? 00:00:00/u01/app/11.2.0/grid/bin/mdnsd.bin
Grid 2422 1 0 10:48? 00:00:00/u01/app/11.2.0/grid/bin/gpnpd.bin
Grid 2432 1 0 10:48? 00:00:00/u01/app/11.2.0/grid/bin/gipcd.bin
Grid 2491 1 0 10:48? 00:00:00/u01/app/11.2.0/grid/bin/ocssd.bin
Grid 2623 1 0 10:49? 00:00:00/u01/app/11.2.0/grid/bin/evmd.bin
Grid 2837 2623 0 10:50? 00:00:00/u01/app/11.2.0/grid/bin/evmlogger.bin-o/u01/app/11.2.0/grid/evm/log/evmlogger.info-l/u01/app/11.2.0/ Grid/evm/log/evmlogger.log
Grid 2885 1 0 10:50? 00:00:00/u01/app/11.2.0/grid/bin/scriptagent.bin
Grid 2887 1 0 10:50? 00:00:00/u01/app/11.2.0/grid/bin/oraagent.bin
Grid 2984 1 0 10:50? 00:00:00/u01/app/11.2.0/grid/opmn/bin/ons-d
Grid 2985 2984 0 10:50? 00:00:00/u01/app/11.2.0/grid/opmn/bin/ons-d
Grid 3029 1 0 10:50? 00:00:00/u01/app/11.2.0/grid/bin/tnslsnr Listener_scan1-inherit
Grid 3046 1 0 10:50? 00:00:00/u01/app/11.2.0/grid/bin/tnslsnr Listener-inherit

"Solution"

For special . So file validation when a file is found to be occupied, use the following method to confirm:

If a file is occupied, kill the occupation process:

Opatch error code 73:prerequisite check "Checkactivefilesandexecutables" failed. (Document ID 1942237.1)

by verifying that the oc4j resource online caused the special file to be occupied by the process, using CRSCTL stat res-t to view the status of the OC4J resource, the resource causes 8888 vulnerabilities, recommends stopping the resource, and reviewing the official documentation for modifications oc4j

Security Vulnerability Scan detects exposed Port on ora.oc4j Resource (document ID 1922349.1)

The Oracle Containers for Java port 8888,oracle Remote Method invocation Port 23792,23943 is a ora.oc4j resource vulnerability. The vulnerability was addressed in Grid PSU 11.2.0.3.4 and later.suggested FIX: One: Stop oc4j resource: Srvctl stop oc4j, disable oc4j service: srvctl disable oc4j. Two: Modify the configuration file of the OC4J resource to prohibit the portif the process still exists after the resource has been stopped, you can kill the process by killing it. After upgrading the PSU, this version triggers bug 22730454 to modify the file $oracle_home/lib/libsqlplus.so permissions 640 to 644. Permission of $OH/lib/libsqlplus. So changes from 644 to 640 on applying 11.2.0.4/12.1.0.2 DBPSU (document ID 2201729.1)

Summary

In the project, must ensure that the pre-engineering environment has been checked to complete, so as to make the process encountered more problems.

In the upgrade encountered problems, carefully review the upgrade log error information in order to accurately determine the cause of the problem.

Plan must be fully prepared, plan audit must be careful, after encountering problems must add content in the program, to prevent the next project encountered the same problem.

Oracle Upgrade PSU&OJVM experiencing problems