ORA-01565: error in identifying file '+ DATA/spfilerac. ora'

Environment:

DB: 11.2.0.2 rac OS: RHEL 5.6

The following problems are encountered when upgrading a single machine to RAC under Oracle 11gR2 today.

1. [Oracle @ 11rac5 ~] $ Sqlplus/as sysdba
2.  
3. SQL * Plus: Release 11.2.0.2.0 Production on Tue Oct 9 19:06:51 2012
4.  
5. Copyright (c) 1982,201 0, Oracle. All rights reserved.
6.  
7. Connected to an idle instance.
8.  
9. SQL> startup
10. ORA-01078: failure in processing system parameters
11. ORA-01565: error in identifying file '+ DATA/spfilerac. ora'
12. ORA-17503: ksfdopn: 2 Failed to open file + DATA/spfilerac. ora
13. A ORA-01034: ORACLE not available
14. ORA-27123: unable to attach to shared memory segment
15. Linux-x86_64 Error: 13: Permission denied
16. Additional information: 3833863
17. Additional information: 10

View the permissions of oracle files under the grid and oracle users

1. View oracle permissions under the grid user
2. [Root @ 11rac5 log] # su-grid
3. [Grid @ 11rac5 ~] $ Ls-l $ ORACLE_HOME/bin/oracle
4. -Rwxr-x -- x 1 grid oinstall 200678430 Oct 9/u01/app/11.2.0/grid/bin/oracle
5. The permission is incorrect. Modify the permission.
6. [Grid @ 11rac5 ~] $ Chmod 6751 $ ORACLE_HOME/bin/oracle
7. [Grid @ 11rac5 ~] $ Ls-l $ ORACLE_HOME/bin/oracle
8. -Rwsr-s -- x 1 grid oinstall 200678430 Oct 9/u01/app/11.2.0/grid/bin/oracle
9. View oracle permissions under an oracle user
10. [Oracle @ 11rac5 trace] $ ls-l $ ORACLE_HOME/bin/oracle
11. -Rwsr-x -- x 1 oracle asmadmin 228886426 Oct 9/u01/app/oracle/product/11.2.0/db_2/bin/oracle
12.  
13. Modify it under the grid user
14. [Oracle @ 11rac5 trace] $ su-grid
15. Password:
16. [Grid @ 11rac5 ~] $ Cd $ ORACLE_HOME/bin/
17. [Grid @ 11rac5 bin] $ set
18. Set setasmgid setasmgidwrap setfattr setkeycodes setmetamode setsid setup
19. Setarch setasmgid0 setfacl setfont setleds setserial setterm setxkbmap
20. [Grid @ 11rac5 bin] $ setasmgidwrap o =/u01/app/oracle/product/11.2.0/db_2/bin/oracle
21. [Grid @ 11rac5 bin] $ ls-l/u01/app/oracle/product/11.2.0/db_2/bin/oracle
22. -Rwsr-s -- x 1 oracle asmadmin 228886426 Oct 9/u01/app/oracle/product/11.2.0/db_2/bin/oracle

Start the database again:

1. Restart normally
2. [Oracle @ 11rac5 ~] $ Sqlplus/as sysdba
3.  
4. SQL * Plus: Release 11.2.0.2.0 Production on Tue Oct 9 19:28:34 2012
5.  
6. Copyright (c) 1982,201 0, Oracle. All rights reserved.
7.  
8. Connected to an idle instance.
9.  
10. SQL> startup
11. ORACLE instance started.
12.  
13. Total System Global Area 839282688 bytes
14. Fixed Size 2231128 bytes
15. Variable Size 557843624 bytes
16. Database Buffers 276824064 bytes
17. Redo Buffers 2383872 bytes
18. Database mounted.
19. Database opened.