1. Prepare three nodes
A SAN device.
Two Oracle RAC nodes, 2 NICs per node
2. Assigning IP addresses
Saneth0 10.0.0.1
C1eth0 192.168.33.101 eth0:1 192.168.33.201
C2eth0 192.168.33.102eth0:1 192.168.33.202
Add a virtual IP to eth0 using the following command
Ifconfig eth0:1 192.168.33.201 netmask 255.255.255.0
Ifconfig eth0:1 192.168.33.202 netmask 255.255.255.0
If a configuration error is removed using the following command
IP addr del 192.168.33.202 dev eth1
3, the installation of NTP server as a cluster clock timing system, can be installed on the Ipsan device
On the SAN, edit the/etc/ntp.conf
Retrict default Nomodify
Restrict 127.0.0.1
Server 127.127.1.0
Fudge 127.127.1.0 Stratum 8
Driftfile/var/lib/ntp/drift
Broadcastdelay 0.008
Then restart the NTPD service
Service NTPD Restart
Sync the clock on the C1, C2 host
Crontab-e
*/5 * * * */usr/sbin/ntpdate xxxxx
Sync every five minutes
4, modify the kernel parameters on C1, C2
Vim/etc/sysctl.conf
Net.ipv4.ip_forward = 1
Net.ipv4.conf.default.rp_filter = 1
Net.ipv4.conf.default.accept_source_route = 0
KERNEL.SYSRQ = 0
Kernel.core_uses_pid = 1
Net.ipv4.tcp_syncookies = 1
KERNEL.MSGMNB = 65536
Kernel.msgmax = 65536
Kernel.shmmax = 2147483648
Kernel.shmall = 268435456
Kernel.shmmni = 4096
Kernel.shmall = 2097152
Kernel.sem = 250 32000 100 128
Fs.file-max = 65536
Net.ipv4.ip_local_port_range = 1024 65000
Net.core.rmem_default = 262144
Net.core.rmem_max = 262144
Net.core.wmem_default = 262144
Net.core.wmem_max = 262144
5. Create Oracle User and DBA, Oinstall user Group
Groupadd Oinstall
Groupadd dba
Useradd-m-G oinstall-g dba Oracle
6. Edit the/etc/hosts file
Vim/etc/hosts
127.0.0.1localhost
192.168.33.101c1
192.168.33.201c1-vip
10.0.0.2c1-priv
192.168.33.102c2
192.168.33.202c2-vip
10.0.0.3c2-priv
10.0.0.1san
Copy the content on C1, C2
7, all nodes must be configured Hangcheck-timer: Used to monitor whether the Linux kernel hangs
Vim/etc/modprobe.conf
Options Hangcheck-timer hangcheck_tick=30 hangcheck_margin=180
Vim/etc/rc.local
Modprobe Hangcheck-timer
Check if the Hangcheck-timer module is already loaded:
Lsmod | grep Hangcheck_timer
8, configure the Oracle user dual-machine (multi-machine) mutual trust
Su-oracle
SSH-KEYGEN-T RSA
Ssh-keygen-t DSA
CD. SSH
Cat *.pub > Authorized_keys
Each node is then
Addition of cat *.pub > Authorized_keys
9, Configuration Ipsan
On the San host
Yum-y Install Scsi-target-utils
Yum-y Install Iscsi-initiator-utils
Vim/etc/tgt/targets.conf
Backing-store/dev/sdb1
vender_id IET
product_id V1
Backing-store/dev/sdc1
vender_id IET
product_id V2
Backing-store/dev/sdd1
vender_id IET
product_id V3
Backing-store/dev/sde1
vender_id IET
product_id V4
Backing-store/vote/disk1.img
vender_id IET
product_id V5
Backing-store/vote/disk2.img
vender_id IET
product_id V6
Service TGTD Restart
Chkconfig TGTD on
10. Import Ipsan Public Storage
Yum Install Iscsi-initiator-utils-y
Service Iscsid Start
Iscsiadm-m discovery-t st-p San
Service iSCSI Start
Chkconfig Iscsid on
Chkconfig iSCSI on
11, install the dependent package C1, C2
Yum Install binutilscompat-libstdc++ Elfutils-libelfelfutils-libelf-develglibcglibc-commonglibc-develglibc-headersgccgcc-c++libaiolibaio-devel Libgcclibstdc++libstdc++-develmakesysstatunixodbcunixodbc-devel-y
12, install ORACLEASM package C1, C2
RPM-IVH oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7-1.el5.x86_64.rpm
13, installation Cluster
cd/mnt/clusterware/cluvfy/
./runcluvfy.sh Stage-pre Crsinst-nc1,c2-verbose
Cd/mnt/clusterware/
./runinstaller-ignoresysprereqs
On the Specify Home details page
Manual modification of CRS installation endpoint:/u01/crs_1
On the Specify Cluster configuration page
Specify two nodes
C1c1-privc1-vip
C2c2-privc2-vip
On the Specify Network Interface usage page
Eth0192.168.33.0public
Eth010.0.0.0private
On the Specify Oracle Cluster Registry (OCR) Location page
Specified
External Redundancy
Specify OCR location:/DEV/RAW/RAW1
On the Specify Voting Disk location page
Specified
External Redundancy
Voting Disk Location:/dev/raw/raw2
14, installation cluster follow-up work
Running in C1
/u01/app/oracle/orainventory/orainstroot.sh
Running in C2
/u01/app/oracle/orainventory/orainstroot.sh
Modify two scripts on two nodes to prevent bugs from appearing
Vim/u01/crs_1/bin/vipca
ld_assume_kernel=2.4.19
Export Ld_assume_kernel
Fi
Unset Ld_assume_kernel
Vim/u01/crs_1/bin/srvctl
Export Ld_assume_kernel
Unset Ld_assume_kernel
Running in C1
/u01/crs_1/root.sh
Running in C2
/u01/crs_1/root.sh
Run/u01/crs_1/root.sh on the last node will be an error
Running VIPCA (silent) for configuring Nodeapps
Error 0 (Native:listnetinterfaces:[3])
[Error 0 (native:listnetinterfaces:[3])]
You need to manually set up Oracle's IP:
Cd/u01/crs_1/bin
-------------------------------------------------------------------
./oifcfg Iflist
Eth0 192.168.33.0
Eth0 192.168.33.0
./oifcfg Setif-global Eth0/192.168.33.0:public
./oifcfg Setif-global Eth0:1/192.168.33.0:cluster_interconnect
./oifcfg Getif
Eth0 192.168.33.0 Global Public
Eth0:1 192.168.33.0 Global Cluster_interconnect
Run VIPCA
/u01/crs_1/bin/vipca
Specify IP in STEP2
c1c1-vip192.168.1.201255.255.255.0
c2c2-vip192.168.1.202255.255.255.0
If you find that the ONS service cannot start at startup, you can temporarily ignore it and start it after restarting the host.
If you encounter a CRS-0184 error
You can try restarting the CRS daemon/etc/rc.d/init.d/init.crs start
If you have a problem, try viewing/var/log/messages to view system-level errors
Two scripts are running and you're finished installing cluster.
Then use Crs_stat-t to view the status, if it is the online status is normal.
15. Installing the Oracle Database engine
On the Select Installation Type page
Select Enterprise Edition
On the Specify Home details page
Fill in Path:/u01/app/oracle/product/10.2.0/db_1
In Specify Hardware Cluster installation Mode
Tick two nodes C1,c2
On the Select Configuration option page
Select Install Database Software only
After installation, it runs on C1 and C2.
/u01/app/oracle/product/10.2.0/db_1/root.sh Script
16. Install ASM DB Instance
Configure ORACLEASM on the C1
/etc/init.d/oracleasm Configure
Create the ORACLEASM disk on C1 first
/etc/init.d/oracleasm Createdisk D1/DEV/SDB1
/etc/init.d/oracleasm Createdisk D2/DEV/SDC1
/etc/init.d/oracleasm Createdisk D3/DEV/SDD1
/etc/init.d/oracleasm Createdisk D4/dev/sde1
Configure ORACLEASM on the C2
/etc/init.d/oracleasm Configure
Scan the changes of oracleasm on C2
/etc/init.d/oracleasm Scandisks
Creating an ASM instance with DBCA in C1
Select D1, D2, D3, D4, select Normal mode
17. Create a database on ASM
Start DBCA
Slightly
Oracle 10g RAC with ASM installed on RHEL5 (simplified version)