Problem Description:
CRS fails to start, and the RAC process exits all.
To view the messages log:
... ...
APR 15:58:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7510.
APR 15:58:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7264.
APR 15:58:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7174.
APR 15:59:31 node74 su: (to Oracle) root on None
APR 15:59:31 node74 su: (to Oracle) root on None
APR 15:59:31 node74 su: (to Oracle) root on None
APR 15:59:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7510.
APR 15:59:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7174.
APR 15:59:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7264.
APR 16:00:26 node74 su: (to Oracle) root on/dev/pts/0
APR 16:00:31 node74 su: (to Oracle) root on None
APR 16:00:31 node74 su: (to Oracle) root on None
APR 16:00:31 node74 su: (to Oracle) root on None
APR 16:00:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7264.
APR 16:00:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7510.
APR 16:00:31 node74 Logger:cluster ready Services waiting on dependencies. Diagnostics in/tmp/crsctl.7174.
... ...
Take one of the files down,/tmp/crsctl.7174:
Oracle Cluster Registry initialization failed with invalid Format:proc-22:the OCR backend have an invalid format
The suspicion is that OCR is damaged. Run the Crsctl Check Boot command, which is consistent with the above log error:
[Email protected]:~> crsctl Check Boot
Oracle Cluster Registry initialization failed with invalid Format:proc-22:the OCR backend have an invalid format
Problem handling:
To see if there is an automatic OCR backup, unfortunately, there is no result output:
[Email protected]:~> ocrconfig-showbackup
---empty
Fortunately, before doing the OCR migration experiment, there was a manual backup of OCR.
Node74:/home/database/oracle/oracrs/bin # Ll/home/oracle/ocr.exp
-rw-r--r--1 root root 87246 Dec 16:45/home/oracle/ocr.exp
OCR backed up prior to import:
Node74:/home/database/oracle/oracrs/bin #./ocrconfig-import/home/oracle/ocr.exp
Check for OCR:
Node74:/home/database/oracle/oracrs/bin #./ocrcheck
Status of Oracle Cluster Registry is as follows:
Version:2
Total Space (Kbytes): 975584
Used Space (Kbytes): 3844
Available Space (Kbytes): 971740
id:811637621
Device/file Name:/DEV/RAW/RAW1
Device/file Integrity Check Succeeded
Device/file Not Configured
Cluster Registry Integrity Check succeeded
Logical corruption Check Succeeded
---repair success
Start CRS:
Node74:/home/database/oracle/oracrs/bin #/etc/init.d/init.crs Start
All RAC processes started successfully:
node74:~ # Su-oracle
[Email protected]:~> crs_stat-t
Name Type Target State Host
------------------------------------------------------------
Ora .... Sm1.asm Application Online Online node74
Ora .... 74.lsnr Application Online Online node74
ORA.NODE74.GSD Application Online Online node74
Ora.node74.ons Application Online Online node74
ORA.NODE74.VIP Application Online Online node74
Ora .... Sm2.asm Application Online Online node76
Ora .... 76.lsnr Application Online Online node76
ORA.NODE76.GSD Application Online Online node76
Ora.node76.ons Application Online Online node76
ORA.NODE76.VIP Application Online Online node76
Ora.orcl.db Application Online Online node74
Ora....l1.inst Application Online Online node74
Ora....l2.inst Application Online Online node76
--Problem solving
RAC recovery operation in the case of an OCR disk failure with backup
