CRS-1006, CRS-0215 fault case

After sles 10 SP3 + Oracle 10g RAC is installed, when the listener is configured, it always prompts that the listening service on the host bo2dbp is already running. If an error is ignored, it is manually enabled on the bo2dbp node, always receive the TNS-12545: connect failed because target host or object does not exist error message. Later, it was found that the VIP of node bo2dbp always drifted to the other node bo2dbs, which turned out to be the culprit ??????

 

1. node bo2dbp listening cannot be started after the Cluster Environment netca
The attempt to manually start the listener is still unsuccessful. No exception is found in the listener. ora and the listener logs, and the host/etc/hosts configuration is normal.
Delete the listener.
Oracle @ bo2dbp: ~> Crs_stat-T
Name type target State host
------------------------------------------------------------
Ora... BP. lsnr application online offline
Ora. bo2dbp. GSD application online bo2dbp
Ora. bo2dbp. ONS application online bo2dbp
Ora. bo2dbp. VIP application online bo2dbs
Ora... BS. lsnr application online bo2dbs
Ora. bo2dbs. GSD application online bo2dbs
Ora. bo2dbs. ONS application online bo2dbs
Ora. bo2dbs. VIP application online bo2dbs

 

2. the node bo2dbp. VIP is moved to bo2dbs.
Oracle @ bo2dbp :~ /Product/10.2.0/crs_1/bin> crs_stat-T
Name type target State host
------------------------------------------------------------
Ora. bo2dbp. GSD application online bo2dbp
Ora. bo2dbp. ONS application online bo2dbp
Ora. bo2dbp. VIP application online bo2dbs
Ora. bo2dbs. GSD application online bo2dbs
Ora. bo2dbs. ONS application online bo2dbs
Ora. bo2dbs. VIP application online bo2dbs

3. Relocate for bo2dbp is not required.
Oracle @ bo2dbp :~ /Product/10.2.0/crs_1/bin>./crs_relocate ora. bo2dbp. VIP-C bo2dbp
Attempting to stop 'ora. bo2dbp. VIP 'on member 'bo2dbs'
Stop of 'ora. bo2dbp. VIP 'on member 'bo2dbs' succeeded.
Attempting to start 'ora. bo2dbp. VIP 'on member 'bo2dbp'
Start of 'ora. bo2dbp. VIP 'on member 'bo2dbp' failed.
Attempting to start 'ora. bo2dbp. VIP 'on member 'bo2dbs'
Start of 'ora. bo2dbp. VIP 'on member 'bo2dbs' succeeded.
CRS-0217: cocould not relocate resource 'ora. bo2dbp. VIP '.

 

4. crs_stop
Oracle @ bo2dbp :~ /Product/10.2.0/crs_1/bin> crs_stop ora. bo2dbp. VIP
Attempting to stop 'ora. bo2dbp. VIP 'on member 'bo2dbs'
Stop of 'ora. bo2dbp. VIP 'on member 'bo2dbs' succeeded.

Oracle @ bo2dbp :~ /Product/10.2.0/crs_1/bin> crs_start ora. bo2dbp. VIP
Attempting to start 'ora. bo2dbp. VIP 'on member 'bo2dbp'
Start of 'ora. bo2dbp. VIP 'on member 'bo2dbp' failed.
Attempting to start 'ora. bo2dbp. VIP 'on member 'bo2dbs'
Start of 'ora. bo2dbp. VIP 'on member 'bo2dbs' succeeded.

I am dizzy and drift to the bo2dbs Node

 

5. Click it and stop the CRS of node 2bo2dbs directly. You can skip this step.
Bo2dbs:/u01/APP/Oracle/product/10.2.0/crs_1/bin #./crsctl stop CRS
Stopping resources. This cocould take several minutes.
Successfully stopped CRS resources.
Stopping cssd.
Shutting down CSS daemon.
Shutdown request successfully issued.

 

6. Show your feet
Oracle @ bo2dbp :~ /Product/10.2.0/crs_1/bin> crs_start ora. bo2dbp. VIP
Attempting to start 'ora. bo2dbp. VIP 'on member 'bo2dbp'
Start of 'ora. bo2dbp. VIP 'on member 'bo2dbp' failed.
Remote Start for 'ora. bo2dbp. VIP 'failed on member 'bo2dbs'
CRS-1006: No more Members to consider

CRS-0215: cocould not start resource 'ora. bo2dbp. VIP '.

 
7. Check log

Oracle @ bo2dbp :~ /Product/10.2.0/crs_1/log/bo2dbp/racg> tail-50 ora. bo2dbp. VIP. Log

16:18:55. 942: [racg] [4250161648] [20571] [4250161648] [ora. bo2dbp. VIP]: End for resource = ora. bo2dbp. VIP, Action = start, status = 1, time = 6.390 s

16:19:30. 968: [racg] [4041843184] [20878] [4041843184] [ora. bo2dbp. VIP]: checkif: Default Gateway is not defined (host = bo2dbp)
Interface eth0 checked failed (host = bo2dbp)
Invalid parameters, or failed to bring up VIP (host = bo2dbp)

It turns out that no default gateway exists ......
Remember that the previous installation encountered no default gateway on node 2, causing vipca to be unable to continue. This time we met again. Khan...
Oracle @ bo2dbp: ~> CAT/etc/sysconfig/Network/routes
Cat:/etc/sysconfig/Network/routes: no such file or directory
Oracle @ bo2dbp: ~> SSH bo2dbs CAT/etc/sysconfig/Network/routes
Default 192.168.7.254 --

After the root account is used to append the gateway to it, everything is OK.

Oracle @ bo2dbs: ~> Crs_stat-T
Name type target State host
------------------------------------------------------------
Ora. bo2dbp. GSD application online bo2dbp
Ora. bo2dbp. ONS application online bo2dbp
Ora. bo2dbp. VIP application online bo2dbp
Ora. bo2dbs. GSD application online bo2dbs
Ora. bo2dbs. ONS application online bo2dbs
Ora. bo2dbs. VIP application online bo2dbs

 

8. Problem Environment
Sles 10/SP3 + Oracle 10g (10.2.0.4)

 

9. Summary:
A. Be careful and careful
B. Quickly locate faults based on corresponding logs