Oracle ORA-07445 [0000000000000000] Error Analysis

1. OS and DB versions

DB Version: 9.2.0.6

OS Version: HP-UXiasd5_pb B .11.23 U ia64 0515426764 unlimited-user license

2. alert log

Thu Oct11 18:14:17 2012

Errors infile/Oracle/product/9.2.0/rdbms/log/ingwdb_ora_17366.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalid permissions for mapped object] [0x000000000] [] []

Thu Oct11 18:15:10 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_17665.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

Thu Oct11 18:15:33 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_18405.trc:

ORA-07445: exception encountered: core dump [9fffffff7f79e8b0] [SIGILL] [Illegal opcode] [0x9FFFFFFF7F79E8B0] [] []

Fri Oct12 10:08:25 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_6934.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

Fri Oct12 10:08:53 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_7134.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

Fri Oct12 10:10:42 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_8290.trc:

ORA-07445: exception encountered: core dump [9fffffff7f79e8b0] [SIGILL] [Illegal opcode] [0x9FFFFFFF7F79E8B0] [] []

Fri Oct12 10:11:46 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_9434.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

Fri Oct12 10:45:00 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_220..trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

Fri Oct12 10:45:26 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_25087.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

Fri Oct12 10:47:14 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_25149.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

Fri Oct12 11:04:11 2012

Errors infile/oracle/product/9.2.0/rdbms/log/ingwdb_ora_4122.trc:

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalidpermissions for mapped object] [0x000000000] [] []

3. Trace file

* ** 11:04:11. 922

* ** Session id: (14.6203) 2012-10-. 922

Exception signal: 11 (SIGSEGV), code: 2 (Invalid permissions for mapped object), addr: 0x0, PC: [0x0, Cannot findsymbol in? Why?

0000000000000000]

R1: 9fffffff7f79f668 r20: 40000000008d5170 br5: 0

R2: c0000000cb643000 r21: 9fffffff7f5082a0 br6: 0

R3: 851b r22: 8 br7: e0000000015917e0

R4: 9fffffff7f508d68 r23: 656e71756575655f ip: 0

R5: 9fffffffffff1dd8 r24: 8 iipa: 0

R6: 9fffffffffff1dd4 r25: 8 cfm: 3

R7: 9fffffffffff1de4 r26: 40000000008d5178 um: 3a

R8: 0 r27: 9fffffff7f5082a8 rsc: 1f

R9: 9fffffff7f740600 r28: 40000000008d5170 bsp: 9fffffff7f801938

R10: 0 r29: 9fffffff7f5082a0 bspstore: 9fffffff7f801938

R11: 60000000003fdc30 r30: 0 rnat: 0

R12: 9fffffffffff1150 r31: 0 ccv: 1

R13: 9fffffff7f7cd420 NaTs: 0 unat: 0

R14: 20175736f75369365 PRs: cc5b fpsr: 9804c8a74433f

R15: 656e71756575655f br0: 4000000002835ec0 pfs: c0000000060f

R16: 2 br1: 0 lc: 0

R17: c0000000919d2800 br2: 0 ec: 0

R18: 60000000003ec990 br3: 0 isr: 9fffffff7f801938

R19: 73 br4: 0 ifa: 0

Redis code: 0052

* ** 11:04:11. 923

Ksedmp: internal or fatal error

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalid permissions for mapped object] [0x000000000] [] []

Current SQL statement for this session:

INSERT into stats $ RESOURCE_LIMIT (SNAP_ID, DBID, INSTANCE_NUMBER, RESOURCE_NAME, CURRENT_UTILIZATION, clerk, INITIAL_ALLOCATION, LIMIT_VALUE) SELECT: B3,: B2,: B1, RESOURCE_NAME, clerk, clerk, INITIAL_ALLOCATION, LIMIT_VALUE from v $ RESOURCE_LIMIT WHERE LIMIT_VALUE! = 'Limited' AND MAX_UTILIZATION> 0

----- PL/SQL Call Stack -----

Object line object

Handle number name

C00000009284ced8 2235 package body PERFSTAT. STATSPACK

C00000009284ced8 91 package body PERFSTAT. STATSPACK

C000000093a2f120 1 anonymous block

4. Locate Problems and Solutions

This error is caused by a bug 3628622 in Oracle 9.2.0.6. There are two bugs related to select and insert for V $ RESOURCE_LIMIT:

Bug 4171822: SELECT * from v $ RESOURCE_LIMIT fails with ORA-07445:

ORA-7445 [Qerfxfetch] On Insert Into STATS $ RESOURCE_LIMIT [ID 742723.1] (bug 3628622)

According to the information in the trace file, here we are the ORA-7445 triggered during insert. So the corresponding bug: 3628622.

This bug does not affect the database. Oracle does not provide one-off patches for this bug. To solve this bug, you must upgrade the database to a higher version. Upgrade to 11.2.0.3.4.

5. underlying causes of the problem

The underlying cause of this bug is described in another article on MOS:

ORA-7445 Errors on Itanium Platforms due toItanium Symbol Preemption [ID 302172.1]

Cause

Due to Intel's elf abi Architecture onItanium Platforms code constructs like:

(* Function_pointer) (<list ofparameters>)

I. e. dereferencing a function pointervariable allows for symbol preemption.

On Itanium global variables are adressedindirectly through a global offset process table. The offsets are relative tothe global pointer address (gp ).

At runtime due to symbol preemption thefunction pointer address may end up at a location where it cannot be directlyaddressed from the gp value.

This was seen to happen with Oraclefunction pointer variables which were stored in and later reread from the SGA.

As a result the process cocould not find theexecutable code address and terminated with SIGSEGV.