1. Database Start cluster error
[[email protected] bin]# ./crs_stat -t -v Name Type R/RA F/FT Target State Host ---------------------------------------------------------------------- ora.BACKUP.dg ora....up.type 0/5 0/ ONLINE ONLINE db1 ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE db1 ora....ER.lsnr ora....er.type 0/5 0/ ONLINE OFFLINE ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE OFFLINE ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE db1 ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE db1 ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE db1 ora....SM1.asm application 0/5 0/0 ONLINE ONLINE db1 ora....B1.lsnr application 0/5 0/0 ONLINE OFFLINE ora.db1.gsd application 0/5 0/0 OFFLINE OFFLINE ora.db1.ons application 0/3 0/0 ONLINE OFFLINE ora.db1.vip ora....t1.type 0/0 0/0 ONLINE ONLINE db1 ora....SM2.asm application 0/5 0/0 ONLINE ONLINE db2 ora....B2.lsnr application 0/5 0/0 ONLINE OFFLINE ora.db2.gsd application 0/5 0/0 OFFLINE OFFLINE ora.db2.ons application 0/3 0/0 ONLINE OFFLINE ora.db2.vip ora....t1.type 0/0 0/0 ONLINE ONLINE db2 ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE ora....network ora....rk.type 0/5 0/ ONLINE ONLINE db1 ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE OFFLINE ora.ons ora.ons.type 0/3 0/ ONLINE OFFLINE ora.racdb.db ora....se.type 0/2 0/1 ONLINE OFFLINE ora....ry.acfs ora....fs.type 0/5 0/ ONLINE ONLINE db1 ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE OFFLINE [[email protected] bin]# ./srvctl status listener Listener LISTENER is enabled Listener LISTENER is not running [[email protected] bin]# ./srvctl start listener PRCR-1079 : Failed to start resource ora.LISTENER.lsnr CRS-5016: Process "/u01/app/11.2.0/grid/bin/lsnrctl" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/db2/agent/crsd/oraagent_grid/oraagent_grid.log" CRS-5016: Process "/u01/app/11.2.0/grid/bin/lsnrctl" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/db1/agent/crsd/oraagent_grid/oraagent_grid.log" CRS-5016: Process "/u01/app/11.2.0/grid/bin/lsnrctl" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/db2/agent/crsd/oraagent_grid/oraagent_grid.log" CRS-5016: Process "/u01/app/11.2.0/grid/bin/lsnrctl" spawned by agent "/u01/app/11.2.0/grid/bin/oraagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/db1/agent/crsd/oraagent_grid/oraagent_grid.log" CRS-2674: Start of ‘ora.LISTENER.lsnr‘ on ‘db2‘ failed CRS-2674: Start of ‘ora.LISTENER.lsnr‘ on ‘db1‘ failed
[Email protected] oraagent_grid]# tail-50 Oraagent_grid.log
2018-05-22 09:53:56.551: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] Adding environment Variables tns_admin=/u01/app/11.2.0/grid/network/ admin/
2018-05-22 09:53:56.551: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] Adding environment variable from usr_ora_env Oracle_base=/u01/app/grid
2018-05-22 09:53:56.551: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] utils:execcmd action = 3 flags = Ohome = (null) cmdname = Lsnrctl.
2018-05-22 09:53:56.551: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] Getoraclehomeattrib:oracle_home =/u01/app/11.2.0/grid
2018-05-22 09:53:56.653: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:56.653: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) lsnrctl for Linux:version 11.2.0.4.0-production on 22- MAY-2018 09:53:56
2018-05-22 09:53:56.653: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:56.653: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Copyright (c) 1991, Oracle. All rights reserved.
2018-05-22 09:53:56.653: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:56.653: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Connecting to (Description= (address= (PROTOCOL=IPC) (KEY =listener)))
2018-05-22 09:53:56.653: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:58.255: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Tns-12541:tns:no LISTENER
2018-05-22 09:53:58.255: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Tns-12560:tns:protocol Adapter Error
2018-05-22 09:53:58.255: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Tns-00511:no Listener
2018-05-22 09:53:58.255: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Linux Error:111:connection refused
2018-05-22 09:53:58.255: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) utils:execcmd scls_process_join () Uret 1
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] execcmd ret = 1
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) lsnrctl for Linux:version 11.2.0.4.0-production on 22- MAY-2018 09:53:56
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Copyright (c) 1991, Oracle. All rights reserved.
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Connecting to (Description= (address= (PROTOCOL=IPC) (KEY =listener)))
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Tns-12541:tns:no LISTENER
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Tns-12560:tns:protocol Adapter Error
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Tns-00511:no Listener
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:) Linux Error:111:connection refused
2018-05-22 09:53:58.256: [Ora. listener.lsnr][3503482624]{1:4489:169} [Check] (: CLSN00010:)
2018-05-22 09:53:58.256: [agfw][3501381376]{1:4489:169} ora. Listener.lsnr DB1 1 state changed from:starting to:offline
2018-05-22 09:53:58.257: [agfw][3501381376]{1:4489:169} Agent sending last reply For:resource_start[ora. Listener.lsnr DB1 1] ID 4,098:850
2018-05-22 09:54:07.297: [clsframe][3522594592] TM [multithread] is changing desired thread # to 5. Current # is 6
2018-05-22 09:54:07.298: [Clsframe][2876454656]{0:1:8} Worker thread is exiting in TM [multithread] to meet the desired CO Unt of 5. New Count is 5
2018-05-22 09:54:37.120: [Agfw][3501381376]{1:4489:2} Agent received the Message:agent_hb[engine] ID 12,293:956
2018-05-22 09:54:37.120: [Agfw][3501381376]{1:4489:2} Deleting the Resource:ora. Listener_scan1.lsnr 1 1
2018-05-22 09:54:37.272: [Ora.asm][2882758400]{1:4489:2} [Check] Asmproxyagent:setattrsfromsrcres 2 m_oracleSid +ASM1 CmdId 260 Checktype 3 Flag 32
2018-05-22 09:54:37.272: [Ora.asm][2882758400]{1:4489:2} [Check] crscmd::clscrscmddata::stat entity 1 StatFlag 32 Usefilter 0
2018-05-22 09:54:37.299: [Usrthrd][2882758400]{1:4489:2} thread:asm Dedicatedthreadstart {
2018-05-22 09:54:37.299: [Usrthrd][2882758400]{1:4489:2} thread:asm Dedicatedthreadstart}
2018-05-22 09:54:37.299: [Usrthrd][2876454656]{1:4489:2} ASM dedicated Thread {
2018-05-22 09:54:37.299: [usrthrd][2876454656]{1:4489:2} asmproxyagent::setgenusrorainst updating [email protected] ( DB1) to +asm1
2018-05-22 09:54:37.299: [Ora.asm][2882758400]{1:4489:2} [Check] crscmd::clscrscmddata::stat entity 1 StatFlag 33 Usefilter 0
2018-05-22 09:54:37.300: [Usrthrd][2876454656]{1:4489:2} crscmd::clscrscmddata::stat entity 1 statflag useFilter 0
2018-05-22 09:54:37.320: [Ora.asm][2882758400]{1:4489:2} [Check] asmproxyagent::check clsagfw_res_status 0
2018-05-22 09:54:37.327: [Usrthrd][2876454656]{1:4489:2} setresattrib:attr [email protected] (DB1) CLSAGFW AttribVal + ASM1 Clscrs Tmpattrvalue +ASM1
2018-05-22 09:54:37.327: [Usrthrd][2876454656]{1:4489:2} setresattrib clsagfw_modify_attribute attr [email protected] (DB1) value +asm1 RetCode 0
2018-05-22 09:54:37.327: [Usrthrd][2876454656]{1:4489:2} ASM dedicated Thread}
2018-05-22 09:54:37.327: [Usrthrd][2876454656]{1:4489:2} thread:asm dedicatedthreadisrunning is reset to false here
2018-05-22 09:55:07.122: [Agfw][3501381376]{1:4489:2} Agent received the Message:agent_hb[engine] ID 12,293:975
View/etc/hosts file, find 127.0.0.1 commented, open note, restart CRS
[[email protected] oraagent_grid]# cat /etc/hosts #127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 [[email protected] oraagent_grid]# vi /etc/hosts #127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
[[email protected] oraagent_grid]# cd /u01/app/11.2.0/grid/bin [[email protected] bin]# ./crsctl stop cluster -all CRS-2673: Attempting to stop ‘ora.crsd‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.crsd‘ on ‘db2‘ CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘db1‘ CRS-2673: Attempting to stop ‘ora.scan1.vip‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.db1.vip‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.OCR.dg‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.registry.acfs‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.racdb.db‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.oc4j‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.cvu‘ on ‘db1‘ CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘db2‘ CRS-2673: Attempting to stop ‘ora.db2.vip‘ on ‘db2‘ CRS-2673: Attempting to stop ‘ora.OCR.dg‘ on ‘db2‘ CRS-2673: Attempting to stop ‘ora.registry.acfs‘ on ‘db2‘ CRS-2673: Attempting to stop ‘ora.racdb.db‘ on ‘db2‘ CRS-2677: Stop of ‘ora.cvu‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.db2.vip‘ on ‘db2‘ succeeded CRS-2677: Stop of ‘ora.racdb.db‘ on ‘db1‘ succeeded CRS-2673: Attempting to stop ‘ora.BACKUP.dg‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.DATA.dg‘ on ‘db1‘ CRS-2677: Stop of ‘ora.racdb.db‘ on ‘db2‘ succeeded CRS-2673: Attempting to stop ‘ora.BACKUP.dg‘ on ‘db2‘ CRS-2673: Attempting to stop ‘ora.DATA.dg‘ on ‘db2‘ CRS-2677: Stop of ‘ora.registry.acfs‘ on ‘db2‘ succeeded CRS-2677: Stop of ‘ora.registry.acfs‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.scan1.vip‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.BACKUP.dg‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.DATA.dg‘ on ‘db2‘ succeeded CRS-2677: Stop of ‘ora.DATA.dg‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.BACKUP.dg‘ on ‘db2‘ succeeded CRS-2677: Stop of ‘ora.db1.vip‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.oc4j‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.OCR.dg‘ on ‘db2‘ succeeded CRS-2673: Attempting to stop ‘ora.asm‘ on ‘db2‘ CRS-2677: Stop of ‘ora.OCR.dg‘ on ‘db1‘ succeeded CRS-2673: Attempting to stop ‘ora.asm‘ on ‘db1‘ CRS-2677: Stop of ‘ora.asm‘ on ‘db2‘ succeeded CRS-2673: Attempting to stop ‘ora.net1.network‘ on ‘db2‘ CRS-2677: Stop of ‘ora.net1.network‘ on ‘db2‘ succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘db2‘ has completed CRS-2677: Stop of ‘ora.asm‘ on ‘db1‘ succeeded CRS-2673: Attempting to stop ‘ora.net1.network‘ on ‘db1‘ CRS-2677: Stop of ‘ora.net1.network‘ on ‘db1‘ succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘db1‘ has completed CRS-2677: Stop of ‘ora.crsd‘ on ‘db2‘ succeeded CRS-2673: Attempting to stop ‘ora.ctssd‘ on ‘db2‘ CRS-2673: Attempting to stop ‘ora.evmd‘ on ‘db2‘ CRS-2673: Attempting to stop ‘ora.asm‘ on ‘db2‘ CRS-2677: Stop of ‘ora.crsd‘ on ‘db1‘ succeeded CRS-2673: Attempting to stop ‘ora.ctssd‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.evmd‘ on ‘db1‘ CRS-2673: Attempting to stop ‘ora.asm‘ on ‘db1‘ CRS-2677: Stop of ‘ora.evmd‘ on ‘db2‘ succeeded CRS-2677: Stop of ‘ora.evmd‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.ctssd‘ on ‘db2‘ succeeded CRS-2677: Stop of ‘ora.ctssd‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.asm‘ on ‘db2‘ succeeded CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip‘ on ‘db2‘ CRS-2677: Stop of ‘ora.asm‘ on ‘db1‘ succeeded CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip‘ on ‘db1‘ CRS-2677: Stop of ‘ora.cluster_interconnect.haip‘ on ‘db1‘ succeeded CRS-2673: Attempting to stop ‘ora.cssd‘ on ‘db1‘ CRS-2677: Stop of ‘ora.cluster_interconnect.haip‘ on ‘db2‘ succeeded CRS-2673: Attempting to stop ‘ora.cssd‘ on ‘db2‘ CRS-2677: Stop of ‘ora.cssd‘ on ‘db1‘ succeeded CRS-2677: Stop of ‘ora.cssd‘ on ‘db2‘ succeeded [[email protected] bin]# ./crsctl start cluster -all CRS-2672: Attempting to start ‘ora.cssdmonitor‘ on ‘db1‘ CRS-2672: Attempting to start ‘ora.cssdmonitor‘ on ‘db2‘ CRS-2676: Start of ‘ora.cssdmonitor‘ on ‘db2‘ succeeded CRS-2672: Attempting to start ‘ora.cssd‘ on ‘db2‘ CRS-2672: Attempting to start ‘ora.diskmon‘ on ‘db2‘ CRS-2676: Start of ‘ora.diskmon‘ on ‘db2‘ succeeded CRS-2676: Start of ‘ora.cssdmonitor‘ on ‘db1‘ succeeded CRS-2672: Attempting to start ‘ora.cssd‘ on ‘db1‘ CRS-2672: Attempting to start ‘ora.diskmon‘ on ‘db1‘ CRS-2676: Start of ‘ora.diskmon‘ on ‘db1‘ succeeded CRS-2676: Start of ‘ora.cssd‘ on ‘db2‘ succeeded CRS-2672: Attempting to start ‘ora.ctssd‘ on ‘db2‘ CRS-2676: Start of ‘ora.cssd‘ on ‘db1‘ succeeded CRS-2672: Attempting to start ‘ora.ctssd‘ on ‘db1‘ CRS-2672: Attempting to start ‘ora.cluster_interconnect.haip‘ on ‘db1‘ CRS-2676: Start of ‘ora.ctssd‘ on ‘db2‘ succeeded CRS-2672: Attempting to start ‘ora.evmd‘ on ‘db2‘ CRS-2672: Attempting to start ‘ora.cluster_interconnect.haip‘ on ‘db2‘ CRS-2676: Start of ‘ora.ctssd‘ on ‘db1‘ succeeded CRS-2672: Attempting to start ‘ora.evmd‘ on ‘db1‘ CRS-2676: Start of ‘ora.evmd‘ on ‘db2‘ succeeded CRS-2676: Start of ‘ora.evmd‘ on ‘db1‘ succeeded CRS-2676: Start of ‘ora.cluster_interconnect.haip‘ on ‘db1‘ succeeded CRS-2672: Attempting to start ‘ora.asm‘ on ‘db1‘ CRS-2676: Start of ‘ora.cluster_interconnect.haip‘ on ‘db2‘ succeeded CRS-2672: Attempting to start ‘ora.asm‘ on ‘db2‘ CRS-2676: Start of ‘ora.asm‘ on ‘db1‘ succeeded CRS-2672: Attempting to start ‘ora.crsd‘ on ‘db1‘ CRS-2676: Start of ‘ora.asm‘ on ‘db2‘ succeeded CRS-2672: Attempting to start ‘ora.crsd‘ on ‘db2‘ CRS-2676: Start of ‘ora.crsd‘ on ‘db1‘ succeeded CRS-2676: Start of ‘ora.crsd‘ on ‘db2‘ succeeded [[email protected] bin]# ./crs_stat -t -v Name Type R/RA F/FT Target State Host ---------------------------------------------------------------------- ora.BACKUP.dg ora....up.type 0/5 0/ ONLINE ONLINE db1 ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE db1 ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE db1 ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE db1 ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE db1 ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE db1 ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE db1 ora....SM1.asm application 0/5 0/0 ONLINE ONLINE db1 ora....B1.lsnr application 0/5 0/0 ONLINE ONLINE db1 ora.db1.gsd application 0/5 0/0 OFFLINE OFFLINE ora.db1.ons application 0/3 0/0 ONLINE ONLINE db1 ora.db1.vip ora....t1.type 0/0 0/0 ONLINE ONLINE db1 ora....SM2.asm application 0/5 0/0 ONLINE ONLINE db2 ora....B2.lsnr application 0/5 0/0 ONLINE ONLINE db2 ora.db2.gsd application 0/5 0/0 OFFLINE OFFLINE ora.db2.ons application 0/3 0/0 ONLINE ONLINE db2 ora.db2.vip ora....t1.type 0/0 0/0 ONLINE ONLINE db2 ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE ora....network ora....rk.type 0/5 0/ ONLINE ONLINE db1 ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE ONLINE db1 ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE db1 ora.racdb.db ora....se.type 0/2 0/1 ONLINE ONLINE db1 ora....ry.acfs ora....fs.type 0/5 0/ ONLINE ONLINE db1 ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE db1
Oracle 11g RAC Listener fails to start
Start building with 50+ products and up to 12 months usage for Elastic Compute Service
1 on 1 presale consultation
24/7 Technical Support 6 Free Tickets per Quarter Faster Response
Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.
A comprehensive suite of global cloud computing services to power your business
Payment Methods We Support
