Oracle Database ORA-01172 ORA-01151 fault recovery example

Some customers storage exception power failure, resulting in database startup reported ORA-01172 error, resulting in the database cannot open
Database startup reports ORA-01172 error
Wed Mar 23 14:16:23 2016
ALTER DATABASE OPEN
Wed Mar 23 14:16:24 2016
Beginning crash recovery of 1 threads
Parallel recovery started with 15 processes
Wed Mar 23 14:16:24 2016
Started redo scan
Wed Mar 23 14:16:25 2016
Completed redo scan
62588 redo blocks read, 15 data blocks need recovery
Wed Mar 23 14:16:25 2016
Started redo application
Thread 1: logseq 15050, block 2, scn 2439828667
Wed Mar 23 14:16:25 2016
Recovery of Online Redo Log: Thread 1 Group 1 Seq 15050 Reading mem 0
Mem #0 errs 0:/oracle/oradata/orcl/redo01.log
Wed Mar 23 14:16:25 2016
Completed redo application
Wed Mar 23 14:16:25 2016
Recovery of thread 1 stuck at block 26185 of file 3
Wed Mar 23 14:16:25 2016
Recovery of thread 1 stuck at block 69385 of file 3
Wed Mar 23 14:16:25 2016
Recovery of thread 1 stuck at block 566 of file 2
Wed Mar 23 14:16:25 2016
Recovery of thread 1 stuck at block 89 of file 2
Wed Mar 23 14:16:25 2016
Recovery of thread 1 stuck at block 53769 of file 3
Wed Mar 23 14:16:26 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p012_6540.trc:
ORA-01172: recovery of thread 1 stuck at block 566 of file 2
ORA-01151: use media recovery to recover block, restore backup if needed
Wed Mar 23 14:16:26 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p008_6532.trc:
ORA-01172: recovery of thread 1 stuck at block 53769 of file 3
ORA-01151: use media recovery to recover block, restore backup if needed
Wed Mar 23 14:16:26 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p011_6538.trc:
ORA-01172: recovery of thread 1 stuck at block 69385 of file 3
ORA-01151: use media recovery to recover block, restore backup if needed
Wed Mar 23 14:16:26 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p005_6526.trc:
ORA-01172: recovery of thread 1 stuck at block 26185 of file 3
ORA-01151: use media recovery to recover block, restore backup if needed
Wed Mar 23 14:16:27 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p014_6544.trc:
ORA-01172: recovery of thread 1 stuck at block 89 of file 2
ORA-01151: use media recovery to recover block, restore backup if needed
Wed Mar 23 14:16:27 2016
Aborting crash recovery due to slave death, attempting serial crash recovery
Wed Mar 23 14:16:27 2016
Beginning crash recovery of 1 threads
Wed Mar 23 14:16:27 2016
Started redo scan
Wed Mar 23 14:16:27 2016
Completed redo scan
62588 redo blocks read, 15 data blocks need recovery
Wed Mar 23 14:16:27 2016
Started redo application
Thread 1: logseq 15050, block 2, scn 2439828667
Wed Mar 23 14:16:27 2016
Recovery of Online Redo Log: Thread 1 Group 1 Seq 15050 Reading mem 0
Mem #0 errs 0:/oracle/oradata/orcl/redo01.log
Recovery of thread 1 stuck at block 566 of file 2
Wed Mar 23 14:16:27 2016
Aborting crash recovery due to error 1172
Wed Mar 23 14:16:27 2016
Errors in file/oracle/admin/orcl/udump/orcl_ora_6514.trc:
ORA-01172: recovery of thread 1 stuck at block 566 of file 2
ORA-01151: use media recovery to recover block, restore backup if needed
ORA-1172 signalled during: alter database open...
Alter database recover datafile 1 error
After trying to recover datafile 1, the ORA-600 kcbrapply_4, ORA-600 kcfrbd_3, ORA-600 kcbrapply_12 and other errors are reported.
Thu Mar 24 21:50:18 2016
Alter database recover datafile 1
Thu Mar 24 21:50:18 2016
Media Recovery Start
Parallel recovery started with 15 processes
Thu Mar 24 21:50:18 2016
Recovery of Online Redo Log: Thread 1 Group 1 Seq 15050 Reading mem 0
Mem #0 errs 0:/oracle/oradata/orcl/redo01.log
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p004_13391.trc:
ORA-00600: internal error code, arguments: [kcbrapply_4], [2], [], [], [], [], [], [], []
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p010_13403.trc:
ORA-00600: internal error code, arguments: [kcbrapply_4], [0], [], [], [], [], [], [], []
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p000_13383.trc:
ORA-00600: internal error code, arguments: [kcbrapply_4], [0], [], [], [], [], [], [], []
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p009_13401.trc:
ORA-00600: internal error code, arguments: [kcbrapply_4], [3], [], [], [], [], [], [], []
Thu Mar 24 21:50:19 2016
Hex dump of (file 1, block 61562) in trace file/oracle/admin/orcl/bdump/orcl_p001_13385.trc
Unzip UPT block relative dba: 0x0040f07a (file 1, block 61562)
Bad header found during media recovery
Data in bad block:
Type: 0 format: 0 rdba: 0xf07a0000
Last change scn: 0x916c. dc4b0040 seq: 0x0 flg: 0x00
Spare1: 0x6 spare2: 0xa2 spare3: 0xb088
Consistency value in tail: 0x06010fc1
Check value in block header: 0x601
Block checksum disabled
Thu Mar 24 21:50:19 2016
Hex dump of (file 1, block 55706) in trace file/oracle/admin/orcl/bdump/orcl_p014_13411.trc
Corrupt block relative dba: 0x0040d99a (file 1, block 55706)
Bad header found during media recovery
Data in bad block:
Type: 0 format: 0 rdba: 0xd99a0000
Last change scn: 0x916c. e1ad0040 seq: 0x0 flg: 0x00
Spare1: 0x6 spare2: 0xa2 spare3: 0xa520
Consistency value in tail: 0x06012222
Check value in block header: 0x601
Block checksum disabled
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p006_13395.trc:
ORA-00600: internal error code, arguments: [kcfrbd_3], [1], [3342335], [1], [0], [64000], [], []
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p003_13389.trc:
ORA-00600: internal error code, arguments: [kcfrbd_3], [1], [3932159], [1], [0], [64000], [], []
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p002_13387.trc:
ORA-00600: internal error code, arguments: [kcfrbd_3], [1], [2293759], [1], [0], [64000], [], []
Reread of rdba: 0x0040d99a (file 1, block 55706) found valid data
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p014_13411.trc:
ORA-00600: internal error code, arguments: [kcbrapply_12], [], [], [], [], [], [], [], []
Thu Mar 24 21:50:19 2016
Reread of rdba: 0x0040f07a (file 1, block 61562) found valid data
Thu Mar 24 21:50:19 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p001_13385.trc:
ORA-00600: internal error code, arguments: [kcbrapply_12], [], [], [], [], [], [], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p014_13411.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xB9782BF4] [] []
ORA-00600: internal error code, arguments: [kcbrapply_12], [], [], [], [], [], [], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p006_13395.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xB9C82BF4] [] []
ORA-00600: internal error code, arguments: [kcfrbd_3], [1], [3342335], [1], [0], [64000], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p009_13401.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xB9A02BF4] [] []
ORA-00600: internal error code, arguments: [kcbrapply_4], [3], [], [], [], [], [], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p003_13389.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xB9F02AF4] [] []
ORA-00600: internal error code, arguments: [kcfrbd_3], [1], [3932159], [1], [0], [64000], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p004_13391.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xBA182AF4] [] []
ORA-00600: internal error code, arguments: [kcbrapply_4], [2], [], [], [], [], [], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p010_13403.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xBA402AF4] [] []
ORA-00600: internal error code, arguments: [kcbrapply_4], [0], [], [], [], [], [], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p000_13383.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xB9282AF4] [] []
ORA-00600: internal error code, arguments: [kcbrapply_4], [0], [], [], [], [], [], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p001_13385.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 450] [SIGSEGV] [Address not mapped to object] [0xB9C82AF4] [] []
ORA-00600: internal error code, arguments: [kcbrapply_12], [], [], [], [], [], [], [], []
Thu Mar 24 21:50:23 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p002_13387.trc:
ORA-10562: Error occurred while applying redo to data block (file #1, block #11042)
ORA-10564: tablespace SYSTEM
ORA-01110: data file 1: '/oracle/oradata/orcl/system01.dbf'
ORA-00607: Internal error occurred while making a change to a data block
ORA-00600: internal error code, arguments: [kcfrbd_3], [1], [2293759], [1], [0], [64000], [], []
Alter database recover datafile 3 error
The file recovery mainly reports ORA-600 kcbrsearchflist_2, ORA-600 kdxlin: psno out of range, ORA-600 kcbs_dump_adv_state and other errors
Thu Mar 24 21:52:04 2016
Alter database recover datafile 3
Thu Mar 24 21:52:04 2016
Media Recovery Start
Parallel recovery started with 15 processes
Thu Mar 24 21:52:04 2016
Recovery of Online Redo Log: Thread 1 Group 1 Seq 15050 Reading mem 0
Mem #0 errs 0:/oracle/oradata/orcl/redo01.log
Thu Mar 24 21:52:05 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p007_13462.trc:
ORA-00600: internal error code, arguments: [kdxlin: psno out of range], [], [], [], [], [], [], [], []
Thu Mar 24 21:52:05 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p0020.132.16.trc:
ORA-00600: internal error code, arguments: [kcbrsearchflist_2], [], [], [], [], [], [], [], []
Thu Mar 24 21:52:05 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p007_13462.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 464] [SIGSEGV] [Address not mapped to object] [0xB9F076F4] [] []
ORA-00600: internal error code, arguments: [kdxlin: psno out of range], [], [], [], [], [], [], [], []
Thu Mar 24 21:52:05 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p0020.132.16.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 464] [SIGSEGV] [Address not mapped to object] [0xB9C874F4] [] []
ORA-00600: internal error code, arguments: [kcbrsearchflist_2], [], [], [], [], [], [], [], []
Thu Mar 24 21:52:06 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p007_13462.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 464] [SIGSEGV] [Address not mapped to object] [0xB9F066F4] [] []
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 464] [SIGSEGV] [Address not mapped to object] [0xB9F076F4] [] []
ORA-00600: internal error code, arguments: [kdxlin: psno out of range], [], [], [], [], [], [], [], []
Thu Mar 24 21:52:06 2016
Errors in file/oracle/admin/orcl/bdump/orcl_p0020.132.16.trc:
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 464] [SIGSEGV] [Address not mapped to object] [0xB9C864F4] [] []
ORA-07445: exception encountered: core dump [kcbs_dump_adv_state () + 464] [SIGSEGV] [Address not mapped to object] [0xB9C874F4] [] []
ORA-00600: internal error code, arguments: [kcbrsearchflist_2], [], [], [], [], [], [], [], []
Recovery process
SQL> startup mount
ORACLE instance started.
 
Total System Global Area 2147483648 bytes
Fixed Size 1220432 bytes
Variable Size 369098928 bytes
Database Buffers 1761607680 bytes
Redo Buffers 15556608 bytes
Database mounted.
SQL> select file # from v $ datafile;
 
FILE #
----------
         1
         2
         3
         4
         5
         6
 
6 rows selected.
 
SQL> recover datafile 1;
ORA-03113: end-of-file on communication channel
 
SQL> startup mount
ORACLE instance started.
 
Total System Global Area 2147483648 bytes
Fixed Size 1220432 bytes
Variable Size 369098928 bytes
Database Buffers 1761607680 bytes
Redo Buffers 15556608 bytes
Database mounted.
 
SQL> recover datafile 3;
ORA-03113: end-of-file on communication channel
 
SQL> startup mount
ORACLE instance started.
 
Total System Global Area 2147483648 bytes
Fixed Size 1220432 bytes
Variable Size 369098928 bytes
Database Buffers 1761607680 bytes
Redo Buffers 15556608 bytes
Database mounted.
SQL> recover datafile 5;
Media recovery complete.
SQL> recover datafile 6;
Media recovery complete.
SQL> recover datafile 4;
Media recovery complete.
SQL> recover datafile 2;
Media recovery complete.
SQL> alter database open;
Alter database open
*
ERROR at line 1:
ORA-00607: Internal error occurred while making a change to a data block
ORA-00600: internal error code, arguments: [4194], [57], [11], [], [], [], [], [],
[]
 
SQL> select open_mode from v $ database;
 
OPEN_MODE
----------
READ WRITE
Good luck this time. The bad thing about system is mon_mod $. The undo exception can be rebuilt. Basically, there is no data loss and the database recovery is complete.
An error is reported during the open process to analyze the objects that may cause bad data blocks and determine the processing method to avoid permanent damage to the data blocks.

From: http://www.xifenfei.com/2016/03/ora-01172-ora-0115-recovery.html