Oracle study--oracle 11gR2 RAC CRS startup failure

Oracle study--oracle 11gR2 RAC CRS startup failure

System environment:

Operating system: RedHat EL5

Cluster:oracle 11gR2 Grid

Oracle:oracle 11gR2

In a RAC environment, one of the nodes CRSD the process failed to start:

[[email protected] ~]$ CRSCTL Check CRS
Crs-4638:oracle High Availability Services is online
Crs-4535:cannot communicate with Cluster ready Services
Crs-4529:cluster Synchronization Services is online
Crs-4533:event Manager is online

1. View Logs
[email protected] ~]# Cd/u01/11.2.0/grid/log
[[email protected] log]# ls
CRS Diag wyb666
[email protected] log]# CD wyb666/
[[email protected] wyb666]# ls
admin alertwyb666.log crsd ctssd evmd gnsd mdnsd RACG
Agent Client CSSD DiskMon gipcd gpnpd ohasd SRVM
[email protected] wyb666]# CD CRSD
[[email protected] crsd]# ls
crsd.log crsdOUT.log crsd.trc
[email protected] crsd]# tail Crsd.log
2015-06-08 11:41:28.430: [Ocrasm][3046103824]proprasmcl:asmhandle is NULL
2015-06-08 11:41:28.430: [ocrraw][3046103824]proprinit:could not open raw device
2015-06-08 11:41:28.430: [Ocrasm][3046103824]proprasmcl:asmhandle is NULL
2015-06-08 11:41:28.430: [ocrapi][3046103824]a_init:16!: Backend init unsuccessful: []
2015-06-08 11:41:28.430: [crsocr][3046103824] OCR context init failure. Error:proc-26:error while accessing the physical storage ASM Error [slos:cat=7, opn=kgfoal06, dep=15077, Loc=kgfokge
Ora-15077:could not locate ASM instance serving a required diskgroup
] [7]
2015-06-08 11:41:28.430: [crsd][3046103824][panic] crsd exiting:could not init OCR, code:26
2015-06-08 11:41:28.430: [crsd][3046103824] done.

As can be seen from the above: when the CRS service starts, unable to access the OCR disk, access to ASM DiskGroup failed!

2. View ASM Disk Group Information
[email protected] crsd]# service oracleasm listdisks
asm_data1
Asm_data2
Asm_rcy1
Asm_rcy2
ocr_vote1
Ocr_vote2
Ocr_vote3
[email protected] crsd]# ls-l/dev/oracleasm/disks
Total 0
BRW-RW----1 grid asmadmin 8, June 8 09:23 asm_data1
BRW-RW----1 grid asmadmin 8, June 8 09:23 Asm_data2
BRW-RW----1 grid asmadmin 8, June 8 09:23 Asm_rcy1
BRW-RW----1 grid asmadmin 8, June 8 09:23 Asm_rcy2
BRW-RW----1 grid asmadmin 8, June 8 11:53 ocr_vote1
BRW-RW----1 grid asmadmin 8, June 8 11:53 Ocr_vote2
BRW-RW----1 grid asmadmin 8, June 8 11:53 Ocr_vote3

Workaround:

Restart the CRS service, and then manually start the ASM Instance:

Starting ASM Instance
[Email protected] crsd]# Su-grid

[email protected] ~]$ sqlplus '/as sysasm '
sql*plus:release 11.2.0.1.0 Production on Mon June 8 11:59:26
Copyright (c) 1982, Oracle. All rights reserved.
Connected to an idle instance.
sql> conn/as sysasm
Connected to an idle instance.
sql> Startup
ASM Instance started
Total System Global area 284565504 bytes
Fixed Size 1336036 bytes
Variable Size 258063644 bytes
ASM Cache 25165824 bytes
ASM diskgroups Mounted
ASM diskgroups Volume enabled

sql> Select Name,state from V$asm_diskgroup;
NAME State
------------------------------ -----------
DATA Mounted
DG1 Mounted
RCY1 Mounted

Startup success:
[[email protected] ~]# crsctl Check CRS
crs-4638:oracle High Availability Services is online
Crs-4537:cluster ready Services are online
crs-4529:cluster synchronization Services is online
crs-4533:event Manager is online

This article is from the "Tianya blog," Please make sure to keep this source http://tiany.blog.51cto.com/513694/1659762

Oracle study--oracle 11gR2 RAC CRS startup failure