The Srvctl and Crs_start commands cannot start an Oracle RAC instance, but Sqlplus can start

Today, a strange problem has been found that the SRVCTL and Crs_start commands cannot start an Oracle RAC instance, but with Sqlplus it can start normally. The final reason for this is that the state of the database becomes disable in OCR, and this state is changed to enable after it returns to normal.

The following is a simulation example:

[email protected]:~ $> crs_stat-tname Type Target State Host-------------------------- ----------------------------------ora .... Sm1.asm application online Online His0...rc01ora .... 01.lsnr Application online online HIS0...RC01ORA....C01.GSD application online online His0...rc01ora .... C01.ons Application online online his0...rc01ora....c01.vip application online online His0...rc01ora .... Sm2.asm application online Online His0...rc02ora .... 02.lsnr Application online online HIS0...RC02ORA....C02.GSD application online online His0...rc02ora .... C02.ons Application online online his0...rc02ora....c02.vip application online online His0...rc02ora .... RCDB.DB application OFFLINE offlineora....b1.inst application OFFLINE offlineora....b2.inst application OFFLI NE offline[email protected]:~ $> Ps-ef |     grep ora_ Oracle 23001 16923 0 16:31:27 PTS/1  0:00 grep ora_[email protected]:~ $> crs_start ora.hisdrcdb.hisdrcdb2.instAttempting to start ' Ora.hisdrcdb.hisdrcdb2.inst ' on member ' HIS00MLCDRC02 ' Start of ' ora.hisdrcdb.hisdrcdb2.inst ' on member ' HIS00MLCDRC02 '    Failed. (Failed to start on node His00mlcdrc02) His00mlcdrc01:crs-1019:resource ora.hisdrcdb.hisdrcdb2.inst (application) cannot run on HIS00MLCDRC01 (for resources such as VIPs that can be failover to other nodes, if the start on the original node is unsuccessful, Oracle attempts to start on the other node.) While the instance is a resource that cannot be failover, it is indicated here that instance 2 cannot be started on Node 1) crs-0215:could not start resource ' ora.hisdrcdb.hisdrcdb2.inst '.

[email protected]:~ $> crs_stat-tname Type Target State Host-------------------------- ----------------------------------ora .... Sm1.asm application online Online His0...rc01ora .... 01.lsnr Application online online HIS0...RC01ORA....C01.GSD application online online His0...rc01ora .... C01.ons Application online online his0...rc01ora....c01.vip application online online His0...rc01ora .... Sm2.asm application online Online His0...rc02ora .... 02.lsnr Application online online HIS0...RC02ORA....C02.GSD application online online His0...rc02ora .... C02.ons Application online online his0...rc02ora....c02.vip application online online His0...rc02ora .... RCDB.DB application OFFLINE offlineora....b1.inst application OFFLINE offlineora....b2.inst application ONLIN E offline You can see that instance 2 startup is not successful at this time. [email protected]:~ $> srvctl start instance-d hisdrcdb-i hisdrcdb2Try to start instance 2 with the Srvctl command, and the command will return soon. [email protected]:~ $> crs_stat-tname Type Target State Host-------------------------- ----------------------------------ora .... Sm1.asm application online Online His0...rc01ora .... 01.lsnr Application online online HIS0...RC01ORA....C01.GSD application online online His0...rc01ora .... C01.ons Application online online his0...rc01ora....c01.vip application online online His0...rc01ora .... Sm2.asm application online Online His0...rc02ora .... 02.lsnr Application online online HIS0...RC02ORA....C02.GSD application online online His0...rc02ora .... C02.ons Application online online his0...rc02ora....c02.vip application online online His0...rc02ora .... RCDB.DB application OFFLINE offlineora....b1.inst application OFFLINE offlineora....b2.inst application ONLIN The E-offlinesrvctl command was not started successfully. [email protected]:~ $> sqlplus "/as sysdba" SQl*plus:release 10.2.0.4.0-production on Sat Oct 9 16:37:38 2010Copyright (c) 1982, Oracle. All rights reserved.connected to an idle instance. Sql> Startup;oracle instance started. Total System Global area 1610612736 bytesfixed size 2139192 bytesvariable size 399465416 byte Sdatabase buffers 1174405120 Bytesredo buffers 34603008 bytesdatabase mounted. Database opened. Sql> Show parameter Instance_namename TYPE VALUE---------------------                 -------------------------------------------------------------------instance_name string Hisdrcdb2sql> Select Open_mode from V$database;open_mode--------------------READ write started with the Sqlplus instance successfully. Sql> host Crs_stat-tname Type Target State host-------------------------------------------- ----------------ora .... Sm1.asm application online Online His0...rc01ora .... 01.lsnrApplication online online HIS0...RC01ORA....C01.GSD application online online his0...rc01ora....c01.ons Application online online HIS0...RC01ORA....C01.VIP application online online His0...rc01ora .... Sm2.asm application online Online His0...rc02ora .... 02.lsnr Application online online HIS0...RC02ORA....C02.GSD application online online His0...rc02ora .... C02.ons Application online online his0...rc02ora....c02.vip application online online His0...rc02ora .... RCDB.DB application OFFLINE offlineora....b1.inst application OFFLINE offlineora....b2.inst application ONLIN E offline But the status shown by Crs_stat is still offline. Stop instance 2 first. sql> shutdown immediate;database closed. Database dismounted. ORACLE instance shut down. Sql> exitdisconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0-64bit productionwith the Partiti Oning, real application Clusters, OLAP, Data miningand real application testing Options[email protected]:~ $> ocrdump View Ocrdumpfile ... [DATABASE. Databases.hisdrcdb.enabled]oratext:falsesecurity: {user_permission:procr_all_access, Group_permission:procr_ WRITE, Other_permission:procr_read, User_name:oracle, Group_name:dba}[database. Databases.hisdrcdb.policy]oratext:manualsecurity: {user_permission:procr_all_access, Group_permission:procr_ WRITE, Other_permission:procr_read, user_name:oracle, group_name:dba} ... The database DATABASE.DATABASES.hisdrcdb.ENABLED property shown in OCR is false,database.databases.hisdrcdb.policy to manual, On other databases, you can see that both properties should be true and automatic. [email protected]:~ $> srvctl status database-d hisdrcdb-finstance hisdrcdb1 are disabledinstance hisdrcdb1 is no T running on node his00mlcdrc01instance HISDRCDB2 is disabledinstance hisdrcdb2 are not running on node His00mlcdrc02srvctl The status indicates that the database is disable.  [email protected]:~ $> srvctl enable database-d hisdrcdb[email protected]:~ $> srvctl status database-d Hisdrcdb-finstance HISDRCDB1 is isn't running on node his00mlcdrc01instance HISDRCDB2 was not running on node HIS00MLCDRC02 use SRVCTL command enable data base[email protected]:~ $> ocrdump ocr1 view OCR1: ... [DATABASE. Databases.hisdrcdb.enabled]oratext:truesecurity: {user_permission:procr_all_access, Group_permission:procr_write , Other_permission:procr_read, User_name:oracle, Group_name:dba}[database. Databases.hisdrcdb.policy]oratext:automaticsecurity: {user_permission:procr_all_access, Group_permission:procr_ WRITE, Other_permission:procr_read, user_name:oracle, group_name:dba} ... Both properties revert to true and automatic at this time. [email protected]:~ $> Crs_start ora.hisdrcdb.hisdrcdb1.instAttempting to start ' Ora.hisdrcdb.hisdrcdb1.inst ' On member ' HIS00MLCDRC01 ' Start of ' ora.hisdrcdb.hisdrcdb1.inst ' on member ' HIS00MLCDRC01 ' succeeded. [email protected]:~ $>[email protected]:~ $> Crs_start ora.hisdrcdb.hisdrcdb2.instAttempting to Start ' ora.hisdrcdb.hisdrcdb2.inst ' on member ' HIS00MLCDrc02 ' Start of ' ora.hisdrcdb.hisdrcdb2.inst ' on member ' HIS00MLCDRC02 ' succeeded. [email protected]:~ $> crs_stat-tname Type Target State Host-------------------------- ----------------------------------ora .... Sm1.asm application online Online His0...rc01ora .... 01.lsnr Application online online HIS0...RC01ORA....C01.GSD application online online His0...rc01ora .... C01.ons Application online online his0...rc01ora....c01.vip application online online His0...rc01ora .... Sm2.asm application online Online His0...rc02ora .... 02.lsnr Application online online HIS0...RC02ORA....C02.GSD application online online His0...rc02ora .... C02.ons Application online online his0...rc02ora....c02.vip application online online His0...rc02ora .... Rcdb.db Application online online his0...rc02ora....b1.inst application online online His0...rc01ora .... B2.inst Application ONLINE ONLINE HIS0...RC02 Use the Crs_start command again to start the instance normally. Attached: srvctl disable disables target, meaning CRS won't consider it for automatic startup, failover, or restart. This option was useful to ensure a object that was down for maintenance was not accidentally automatically Restarted.srvctl Enable reenables the specified object.

The

Srvctl and Crs_start commands cannot start an Oracle RAC instance, but Sqlplus can start