OracleBUG: ORA-00600 [kmgs_parameter_update_timeout_1] [17510]

Symptom:
An error is reported in the alert Log when the Oracle database is started:
SUCCESS: diskgroup DATADG was mounted
Errors in file/oracle/app/11gR1/diag/rdbms/rac/rac2/trace/rac2_mmon_1_6.trc (incident = 240612 ):
ORA-00600: internal error code, arguments: [kmgs_parameter_update_timeout_1], [17510], [], [], [], [], [], [], [], [], [], [], []
ORA-17510: Attempt to do I/o beyond file size
Incident details in:/oracle/app/11gR1/diag/rdbms/rac/rac2/incident/incdir_240612/rac2_mmon_1066_i240612.trc
Tue December 31 14:23:25 2013
Trace dumping is refreshing Ming id = [cdmp_20131231142325]
Completed: ALTER DATABASE MOUNT

Error ORA-17510 when modifying parameters:
SQL> alter system set control_files = 'current. 303.835627291 'scope = spfile;
Alter system set control_files = 'current. 303.835627291 'scope = spfile
*
ERROR at line 1:
ORA-17510: Attempt to do I/o beyond file size

SQL>
SQL>
SQL> alter system set log_archive_dest_1 = 'location = + DATADG /';
Alter system set log_archive_dest_1 = 'location = + DATADG /'
*
ERROR at line 1:
ORA-17510: Attempt to do I/o beyond file size

Rac2_mmon_1066_i240612.trc file information:
* ** 14:23:24. 392
Incident 240612 created, dump file:/oracle/app/11gR1/diag/rdbms/rac/rac2/incident/incdir_240612/rac2_mmon_1066_i240612.trc
ORA-00600: internal error code, arguments: [kmgs_parameter_update_timeout_1], [17510], [], [], [], [], [], [], [], [], [], [], []
ORA-17510: Attempt to do I/o beyond file size

KEBM: MMON action policy violation. 'sga memory tuning parameter update 'viol = 0; err = 600
Error 0 detected in background process
OPIRIP: Uncaught error 447. Error stack:
ORA-00447: fatal error in background process
ORA-00600: internal error code, arguments: [kmgs_parameter_update_timeout_1], [17510], [], [], [], [], [], [], [], [], [], [], []
ORA-17510: Attempt to do I/o beyond file size

SQL>
Rac2_mmon_1066_i240612.trc:
14:23:23. 993826: 80008ADE: db_trace: ksl2.c @ 9123: ksliwat (): [10005: 23: 876] ksl post rcvd poster = 15 loc = 'ksa2. h LINE: 282 ID: ksasnd'id1 = 0 id2 = 0 name = type = 0 fac # = 0 facpost = 1
14:23:23. 993838: 80008ADF: db_trace: ksb. c @ 1808: ksbabs (): [10254: 23: 876] KSBABS: (MMON): (requested action): acnum = [50] comment = [SGA memory tuning parameter update]
14:23:23. 995501: 80008AF6: KFNU: kfn. c @ 1719: kfnUStart (): kfnUStart (IN ):
14:23:23. 995503: 80008AF7: KFNU: kfn. c @ 1728: kfnUStart (): Require ASM background process. (pid = 196; state = 3; bootstrap = 1, running = 2)

----- Session Open Cursors -----

----------------------------------------
Cursor #1 (0x2b2949861980) state = BOUND curiob = 0x2b294987cc48
Curflg = d fl2 = 200000 par = (nil) ses = 0x2a5a2fe30
----- Dump Cursor SQL _id = 8p447s6p0rv6b xsc = 0x2b294987cc48 cur = 0x2b2949861980 -----
Dump Parent Cursor SQL _id = 8p447s6p0rv6b phd = 0x2a3538bb8 plk = 0x2a38f6c10
Sqltxt (0x2a3538bb8) = select java_pool_size_for_estimate s, java_pool_size_factor * 100 f, estd_lc_load_time l, 0 from v $ java_pool_advice
Hash = 8b1cd0e04050e97a8a9087c1aa0beccb
Parent = 0x287fe4758 maxchild = 01 plk = 0x2a38f6c10 ppn = n
Cursor instantiation = 0x2b294987cc48 used = 1388471003 exec_id = 0 exec = 0
Child #0 (0x2a35389d8) pcs = 0x287fe3db0
Clk = 0x2a38f6b18 ci = 0x287fe3a50 pn = 0x2a38f6818 ctx = 0x283faf250
Kgsccflg = 0 llk [0x2b294987cc50, 0x2b294987cc50] idx = 0
Xscflg = 100076 fl2 = 40000000 fl3 = 22004 fl4 = 100
Frames pfr (nil) siz = 2120 efr (nil) siz = 2104
Cursor frame dump
Enxt: 2.0x000000b8 enxt: 1.0x00000780
Pnxt: 1.0x00000010

----------------------------------------
Cursor #3 (0x2b2949861aa0) state = BOUND curiob = 0x2b294987c908
Curflg = d fl2 = 200000 par = (nil) ses = 0x2a5a2fe30
----- Dump Cursor SQL _id = aykvshm7zsabd xsc = 0x2b294987c908 cur = 0x2b2949861aa0 -----
Dump Parent Cursor SQL _id = aykvshm7zsabd phd = 0x2a3536398 plk = 0x2a38f6a20
Sqltxt (0x2a3536398) = select size_for_estimate, size_factor * 100 f, estd_physical_read_time, estd_physical_reads from v $ db_cache_advice where id = '3'
Hash = e6a0c9e759694930af4b7884cffc296d
Parent = 0x287fdec20 maxchild = 01 plk = 0x2a38f6a20 ppn = n
Cursor instantiation = 0x2b294987c908 used = 1388471003 exec_id = 0 exec = 0
Child #0 (0x2a35361b8) pcs = 0x287fde278
Clk = 0x2a38f6898 ci = 0x287fddf18 pn = 0x2a3537e78 ctx = 0x283fa0f90
Kgsccflg = 0 llk [0x2b294987c910, 0x2b294987c910] idx = 0
Xscflg = 100076 fl2 = 40000000 fl3 = 22004 fl4 = 100
Frames pfr (nil) siz = 7176 efr (nil) siz = 7160
Cursor frame dump
Enxt: 3.0x00000b78 enxt: 2.0x00000250 enxt: 1.0x00000e30
Pnxt: 1.0x00000010

----------------------------------------
Cursor #4 (0x2b2949861b30) state = BOUND curiob = 0x2b294987c5c8
Curflg = d fl2 = 200000 par = (nil) ses = 0x2a5a2fe30
----- Dump Cursor SQL _id = 772s25v1y0x8k xsc = 0x2b294987c5c8 cur = 0x2b2949861b30 -----
Dump Parent Cursor SQL _id = 772s25v1y0x8k phd = 0x2a3533e18 plk = 0x2a3520.a8
Sqltxt (0x2a3533e18) = select shared_pool_size_for_estimate s, shared_pool_size_factor * 100 f, estd_lc_load_time l, 0 from v $ shared_pool_advice
Hash = ae5675c671b365c6738b022ec3e07512
Parent = 0x287fd7f88 maxchild = 01 plk = 0x2a3520.a8 ppn = n
Cursor instantiation = 0x2b294987c5c8 used = 1388471003 exec_id = 0 exec = 0
Child #0 (0x2a3533c38) pcs = 0x287fd75e0
Clk = 0x2a35384b0 ci = 0x287fd7280 pn = 0x2a3537eb0 ctx = 0x283f872c0
Kgsccflg = 0 llk [0x2b294987c5d0, 0x2b294987c5d0] idx = 0
Xscflg = 100076 fl2 = 40000000 fl3 = 22004 fl4 = 100
Frames pfr (nil) siz = 2120 efr (nil) siz = 2104
Cursor frame dump
Frames pfr (nil) siz = 2120 efr (nil) siz = 2104
Cursor frame dump
Enxt: 2.0x000000b8 enxt: 1.0x00000780
Pnxt: 1.0x00000010

----------------------------------------
Cursor #5 (0x2b2949861bc0) state = BOUND curiob = 0x2b294987c288
Curflg = d fl2 = 200000 par = (nil) ses = 0x2a5a2fe30
----- Dump Cursor SQL _id = g6gu1n3x0h1h4 xsc = 0x2b294987c288 cur = 0x2b2949861bc0 -----
Dump Parent Cursor SQL _id = g6gu1n3x0h1h4 phd = 0x2a1_26d8 plk = 0x2a35383b8
Sqltxt (0x2a000026d8) = select streams_pool_size_for_estimate s, streams_pool_size_factor * 100 f, estd_spill_time + estd_unspill_time, 0 from v $ streams_pool_advice
Hash = 78ee9a4289ed2031f33f41a0fa080604
Parent = 0x287fd2450 maxchild = 01 plk = 0x2a35383b8 ppn = n
Cursor instantiation = 0x2b294987c288 used = 1388471003 exec_id = 0 exec = 0
Child #0 (0x2a11624f8) pcs = 0x287fd1aa8
Clk = 0x2a35382c0 ci = 0x287fd1748 pn = 0x2a3537ee8 ctx = 0x283f79000
Kgsccflg = 0 llk [0x2b294987c290, 0x2b294987c290] idx = 0
Xscflg = 100076 fl2 = 40000000 fl3 = 22004 fl4 = 100
Frames pfr (nil) siz = 2208 efr (nil) siz = 2192
Cursor frame dump
Enxt: 2.0x000000e8 enxt: 1.0x000007a8
Pnxt: 1.0x00000010

----------------------------------------
Cursor #6 (0x2b2949861c50) state = BOUND curiob = 0x2b294987bf48
Curflg = d fl2 = 200000 par = (nil) ses = 0x2a5a2fe30
----- Dump Cursor SQL _id = 5yv7yvjgjxugg xsc = 0x2b294987bf48 cur = 0x2b2949861c50 -----
Dump Parent Cursor SQL _id = 5yv7yvjgjxugg phd = 0x2a352b990 plk = 0x2a3538138
Sqltxt (0x2a352b990) = select TIME_WAITED_MICRO from V $ SYSTEM_EVENT where event = 'shared IO Pool Memory'
Hash = b670d0be0c8dd4595f6cfedc5f1ee9ef
Parent = 0x287fcc918 maxchild = 01 plk = 0x2a3538138 ppn = n
Cursor instantiation = 0x2b294987bf48 used = 1388471003 exec_id = 0 exec = 0
Child #0 (0x2a352b7b0) pcs = 0x287fcbf70
Clk = 0x2a1168040 ci = 0x287fcbc10 pn = 0x2a35341d8 ctx = 0x283f6d198
Kgsccflg = 0 llk [0x2b294987bf50, 0x2b294987bf50] idx = 0
Xscflg = 100076 fl2 = 40000000 fl3 = 22004 fl4 = 100
Frames pfr (nil) siz = 5008 efr (nil) siz = 4992
Cursor frame dump
Enxt: 3.0x00000390 enxt: 2.0x00000298 enxt: 1.0x00000d58
Pnxt: 1.0x00000010

----- Session Cached Cursor Dump -----
----- Generic Session Cached Cursor Dump -----
-----------------------------------------------------------
-------------- Generic Session Cached Cursors Dump --------
-------------------------------------
----- End of Archival Runtime State -----
----- Recovery Context Info -----
--------- Recovery context -------
No recovery context found
----------- End of Recovery context -----------
DbkedDefDump: no current context area
-------------------------------------------------------------------------------
Trace Bucket Dump Begin: default bucket for process 23 (osid: 1066, MMON)
TIME (* = approx): SEQ: COMPONENT: FILE @ LINE: FUNCTION: SECT/DUMP: [EVENT #: PID: SID] DATA
-------------------------------------------------------------------------------
14:23:23. 566604: 8000798B: db_trace: kjcv. c @ 1541: kjcvg0 (): [10425: 23: 876] kjss2m skip ([0x7da8296d] [0x7bf71d2a], [LB]) [owner 1507330] [held-mode 5]
14:23:23. 566608: 8000798C: db_trace: kjcv. c @ 1541: kjcvg0 (): [10425: 23: 876] kjss2m skip ([0x6029d4ac] [0x7cdfa2ab], [NB]) [owner 1507330] [held-mode 3]
14:23:23. 566611: 8000798D: db_trace: kjcv. c @ 1541: kjcvg0 (): [10425: 23: 876] kjss2m skip ([0x6029d4ac] [0x7cdfa2ab], [LB]) [owner 1507330] [held-mode 3]
14:23:23. 567056: 8000798F: db_trace: ksxp. c @ 3220: ksxpvsnd (): [10401: 23: 876] KSXPVSND: client 2 tid (1,257, 0x19befaa1) buf 0x2a7800cc8 sz 128
14:23:23. 569694: 800079AC: db_trace: ksxp. c @ 4354: ksxpwait (): [10401: 23: 876] KSXP_SND_CALLBACK: request 0x2b294941e908, status 30
14:23:23. 569697: 800079AD: db_trace: ksxp. c @ 4382: ksxpwait (): [10401: 23: 876] KSXPWAIT: Send compl suppressed and No requests. proc 0x2a4e3c9c8 haswrk 0
14:23:23. 570021: 800079B0: db_trace: ksl2.c @ 9123: ksliwat (): [10005: 23: 876] ksl post rcvd poster = 11 loc = 'kji. h LINE: 2330 ID: kjata: wake up enqueue owner 'id1 = 0 id2 = 0 name = type = 0 fac # = 3 facpost = 1
14:23:23. 570047: 800079B1: db_trace: ksxp. c @ 3220: ksxpvsnd (): [10401: 23: 876] KSXPVSND: client 2 tid (1,257, 0x19befaa1) buf 0x2a7800cc8 sz 128
14:23:23. 571416: 800079CA: db_trace: ksxp. c @ 4354: ksxpwait (): [10401: 23: 876] KSXP_SND_CALLBACK: request 0x2b294941e350, status 30
14:23:23. 571418: 800079CB: db_trace: ksxp. c @ 4382: ksxpwait (): [10401: 23: 876] KSXPWAIT: Send compl suppressed and No requests. proc 0x2a4e3c9c8 haswrk 0
14:23:23. 571794: 800079CE: db_trace: ksl2.c @ 9123: ksliwat (): [10005: 23: 876] ksl post rcvd poster = 11 loc = 'kji. h LINE: 2330 ID: kjata: wake up enqueue owner 'id1 = 0 id2 = 0 name = type = 0 fac # = 3 facpost = 1
14:23:23. 573076: 800079DA: db_trace: kjcv. c @ 1541: kjcvg0 (): [10425: 23: 876] kjss2m skip ([0x574dcc5e] [0x6a750b5f], [NB]) [owner 1507330] [held-mode 3]
14:23:23. 573079: 800079DB: db_trace: kjcv. c @ 1541: kjcvg0 (): [10425: 23: 876] kjss2m skip ([0x574dcc5e] [0x6a750b5f], [LB]) [owner 1507330] [held-mode 3]
14:23:23. 573726: 800079DD: db_trace: kjcv. c @ 1541: kjcvg0 (): [10425: 23: 876] kjss2m skip ([0x574dcc5e] [0x6a750b5f], [NB]) [owner 1507330] [held-mode 3]
14:23:23. 573729: 800079DE: db_trace: kjcv. c @ 1541: kjcvg0 (): [10425: 23: 876] kjss2m skip ([0x574dcc5e] [0x6a750b5f], [LB]) [owner 1507330] [held-mode 3]
14:23:23. 574191: 800079F6: db_trace: ksxp. c @ 3220: ksxpvsnd (): [10401: 23: 876] KSXPVSND: client 2 tid (1,257, 0x19befaa1) buf 0x2a7800cc8 sz 128
14:23:23. 575912: 80007A0A: db_trace: ksxp. c @ 4354: ksxpwait (): [10401: 23: 876] KSXP_SND_CALLBACK: request 0x2b294941dd98, status 30
14:23:23. 575915: 80007A0B: db_trace: ksxp. c @ 4382: ksxpwait (): [10401: 23: 876] KSXPWAIT: Send compl suppressed and No requests. proc extends haswrk 0

Analysis:
This is a BUG in Oracle. As mentioned in the Oracle error prompt, spfile cannot expand space, so it cannot modify parameter values or add new parameters.
Solution:
Rebuilding spfile:
1. Create a pfile Based on spile;
Create pfile = ''from spfile = '';
Create a spfile Based on pfile:
Create spfile from pfile = '';
In fact, from the dump information of the mmon process, we can see that during the DB Startup Process (specifically in the NOMOUNT stage), MMON will query the v $ * _ advice series memory suggestion view, obtain the recommended size information for each memory pool, and then perform the following two tasks:
1. Modify the recommended value to spfile (because the spfile cannot expand at this time, so the ORA-00600 is reported ).
2. initialize the memory pool size based on the recommended value.