11gR2 Grid Infrastructure Installation prerequisites On LINU

11gR2 Grid Infrastructure Installation prerequisites On LINUX Basic Environment server brand IBM server model X3650M2cpu type Intel Xeon E5620 @ 2.40GHzcpu Number 2 memory size 24g disk array DS3200 hard disk size 1.8 TB software preparation: -- Oracle Database (relational des Oracle Database and Oracle Infrastructure -- Oracle Grid Infrastructure (relational des Oracle ASM, Oracle Clusterware, and Oracle restart1_p10404530_112030_platform_3of7.zip 1 configure yum source vim/etc/yum. repos. d/rhel-debuginfo.repo ORADB1: [Server] name = Serverbaseurl = file:///mnt/Serverenabled=1gpgcheck=0 ORADB2: [Server] name = Serverbaseurl = ftp://oradb1/pub/Serverenabled=1gpgcheck=0 2. Check whether the following package has been installed: rpm-q -- queryformat "% {NAME}-% {VERSION}-% {RELEASE} (% {ARCH }) \ n "\ binutils \ compat-libstdc ++-33 \ elfutils-libelf-devel \ gcc-c ++ \ glibc-common \ glibc- devel \ glibc-headers \ ksh \ libaio-devel \ libgcc \ libstdc ++-devel \ make \ sysstat \ unixODBC-devel check to find my the following four packages are not installed: package libaio-devel is not installedpackage sysstat is not ins Talledpackage unixODBC is not installedpackage unixODBC-devel is not installedpackage sysstat is not installed -- mount the CD image to the mnt directory: [root @ localhost tmp] # mount/dev/cdrom/mnt/mount: block device/dev/cdrom is write-protected, mounting read-only -- yum install these packages [root @ localhost tmp] # yum install libaio-devel package libaio-devel unixODBC-devel sysstat-y -- yum install the second node you can re-mount [root @ localhost tmp] # mo Unt/dev/cdrom/var/ftp/pub/mount: block device/dev/cdrom is write-protected, mounting read-only3. turn off most of the services without service (may vary with the environment ). chkconfig bluetooth -- level 2345 offchkconfig configurations -- level 2345 offchkconfig portmap -- level 2345 offchkconfig sendmail -- level 2345 offchkconfig vsftpd -- level 2345 offchkconfig iptables offchkconfig ntpd off 4 Configure/etc/hosts on each node file, the file content is as follows # Public Network? (Eth0) 10.0.18.12 oradb1.bdstar.com oradb110.0.18.13 oradb2.bdstar.com oradb2 # Public Virtual IP (VIP) addresses? (Eth0: 1) 10.0.18.120 oradb1-vip.bdstar.com oradb1-vip10.0.18.130 oradb2-vip.bdstar.com oradb2-vip # Private Interconnect? (Eth1) 10.10.10.120 oradb1-priv.bdstar.com oradb1-priv10.10.10.130 oradb2-priv.bdstar.com oradb2-priv # Compute node Client Access SCAN Interface details10.0.18.36 oradb-scan.bdstar.com oradb-scan5 Modify host name [root @ localhost ~] # Add the following to vim/etc/sysconfig/networkOradb1: NETWORKING = yesNETWORKING_IPV6 = noHOSTNAME = oradb1.bdstar.com Oradb2: NETWORKING = networkyesing_ipv6 = noHOSTNAME = IPv6 configure the cluster Time Synchronization Service (CTSS) -- Do not use the NTP service on the system. Use the CTSS service of the oracle Cluster [root @ racnode1 ~] #/Sbin/service ntpd stop [root @ racnode1 ~] # Chkconfig ntpd off [root @ racnode1 ~] # Mv/etc/ntp. conf/etc/ntp. conf. original Delete the following files: [root @ racnode1 ~] # Rm/var/run/ntpd. pid 7 kernel parameter configuration [root @ rac1 ~] # Cd/etc/[root @ rac1 etc] # sysctl-pnet. ipv4.ip _ forward = 0net. ipv4.conf. default. rp_filter = 1net. ipv4.conf. default. accept_source_route = 0kernel. sysrq = 0kernel. core_uses_pid = 1net. ipv4.tcp _ syncookies = 1kernel. msgmnb = 65536kernel. msgmax = 65536kernel. shmmax = 68719476736kernel. shmall = 4294967296net. ipv4.ip _ local_port_range = 9000 65500fs. file-max = 6815744fs. suid_dumpable = 1fs. aio-max-nr = 10 48576kernel. shmmni = 4096kernel. sem = 250 32000 100. net. core. rmem_default = 262144net. core. rmem_max = 4192134net. core. wmem_default = 262144net. core. wmem_max = 1048586 8 DNS configuration is only available on node 1 as a DNS server: [root @ localhost etc] # yum install bind-chroot caching-nameserver # vim/var/named/chroot/etc/named. conf options {directory "/var/named" ;}; zone "localdomain" in {type master; file "localdomain. zone "; }; Zone "bdstar.com" IN {type master; file "bdstar.com. zone" ;}; [root @ oradb1 ~] # Cd/var/named/chroot/var/named/[root @ oradb1 named] # vim bdstar.com. zone $ TTL 86400 @ in soa @ root (42; serial (d. adams) 3 H; refresh 15 M; retry 1 W; expiry 1D); minimum @ in ns oradb1.bdstar.com. oradb1 in a 10.0.18.12 oradb2 in a 10.0.18.13 oradb1-vip in a 10.0.18.120 oradb2-vip in a 10.0.18.130 oradb-scan in a 10.0.18.36 [root @ oradb1 named] # vim localdomain. zone $ TTL 86400 @ in soa localhost Root (42; serial (d. adams) 3 H; refresh 15 M; retry 1 W; expiry 1D ); minimum in ns localhostoradb1 in a 10.0.18.12 oradb2 in a 10.0.18.13 oradb1-vip in a 10.0.18.120 oradb2-vip in a 10.0.18.130 oradb-scan in a kernel [root @ oradb1 named] # cat/etc/resolv. confnameserver 10.0.18.12search localdomain bdstar.com [root @ oradb1 named] # service named restart -- test whether it takes effect [root @ oradb1 named] # nslookup Oradb1.bdstar. comServer: 10.0.18.12Address: 10.0.18.12 #53 Name: oradb1.bdstar. comAddress: 10.0.18.12 -- Adjust DNS resolution because oracle strongly recommends that you do not add scan to hosts. Therefore, only one scan ip address can be used. So we can adjust the resolution sequence: [root @ oradb1 log] # vim/etc/nsswitch. confhosts: dns files [root @ oradb1 ~] #/Sbin/service nscd restart 9 create grid and oracle users, operate groupadd-g 1000 oinstallgroupadd-g 1020 asmadmingroupadd-g 1021 asmdbagroupadd-g 1022 asmopergroupadd-g 1300 dba useradd-u 1101-g oinstall-G dba on each node, asmdba-c "Oracle Software Owner" oracleuseradd-u 1100-g oinstall-G asmadmin, asmdba, asmoper, dba-c "Grid Infrastructure Owner" grid -- modify the oracle grid password passwd oraclepasswd grid 10 to create oracle and gr Id of the Oracle Base Directory mkdir-p/u01/app/11.2.0/gridmkdir-p/u01/app/gridchown-R grid: oinstall/u01mkdir-p/u01/app/oraclechown oracle: oinstall/u01/app/oraclechmod-R 775/u01 -- Oracle Inventory Directorymkdir-p/u01/app/oraInventorychown-R grid: oinstall/u01/app/oraInventorychmod-R 755/u01/app/oraInventory 11 configure the grid. The oracle user environment variable node 1grid User :~ /. Bash_profile Add the following content: export ORACLE_BASE =/u01/app/gridexport ORACLE_HOME =/u01/app/11.2.0/gridexport PATH = $ PATH: $ ORACLE_HOME/binexport NLS_LANG = "simplifchinese_china ". AL32UTF8export ORACLE_SID = + ASM1umask 022 stty erase ^ H node 2grid User :~ /. Bash_profile Add the following content: export ORACLE_BASE =/u01/app/gridexport ORACLE_HOME =/u01/app/11.2.0/gridexport PATH = $ PATH: $ ORACLE_HOME/binexport NLS_LANG = "simplifchinese_china ". AL32UTF8export ORACLE_SID = + ASM2umask 022 stty erase ^ H Node 1 ORACLE user :~ /. Bash_profile Add the following content: export ORACLE_BASE =/u01/app/oracleexport ORACLE_HOME = $ ORACLE_BASE/product/11.2.0/dbhome_1export PATH = $ PATH: $ ORACLE_HOME/binexport NLS_LANG = "SIMPLIFIED CHINESE_CHINA ". AL32UTF8export ORACLE_SID = bdspoc1umask 022 stty erase ^ H Node 2 ORACLE user: export ORACLE_BASE =/u01/app/oracleexport ORACLE_HOME = $ ORACLE_BASE/product/11.2.0/dbhome_1export PATH = $ PATH: $ ORACLE_HOME/binexport NLS_LANG = "SIM PLIFIED CHINESE_CHINA ". AL32UTF8export ORACLE_SID = bdspoc2umask 022 stty erase ^ H 12 set user resource limit 1. in the file/etc/security/limits. conf: # Install oracle settingoracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 oracle soft stack 10240 grid soft nproc 2047 grid hard nproc 16384 grid soft nofile 1024 grid hard nofile 65536 grid soft stack 10240 adds the following lines in/etc/pam. d/login file s Ession required pam_limits.so vim/etc/profile if [$ USER = "oracle"] | [$ USER = "grid"]; then if [$ SHELL = "/bin/ksh"]; then ulimit-p 16384 ulimit-n 65536 else ulimit-u 16384-n 65536fi umask 022fi For the C shell (csh or tcsh), add the following lines to the/etc/csh. login file: if ($ USER = "oracle" | $ USER = "grid") then limit maxproc 16384 limit descriptors 65536 endif 13 set RDAC because It uses an IBM disk array. Therefore, you need to install the multi-path software on the system.: http://support.netapp.com/NOW/public/apbu/oemcp/ Decompress the downloaded RDAC package to generate the linuxrdac-09.03.0C05.0638 folder into the folder and compile the package, [root @ oradb1 linuxrdac-09.03.0C05.0638] # makemake [1]: entering directory '/usr/src/kernels/2.6.18-274. el5-x86_64 '.... Gcc mppUtil. o mppUtilSysdep. o-o mppUtilgcc-o genuniqueid. c [root @ oradb1 linuxrdac-09.03.0C05.0638] # make installmake [1]: Entering directory '/tmp/linuxrdac-09.03.0C05.0638 '.... MPP driver package has been successfully installed on your system. -- generate an mpp file in the/boot folder [root @ oradb1 boot] # pwd/boot [root @ oradb1 boot] # lsconfig-2.6.18-274.el5 initrd-2.6.18-274.el5kdump.img lost + found System. map-2.6.18-274.el5initrd-2.6.18-274.el5.img mpp-2.6.18-274.el5.img vmlinuz-2.6.18-274.el5 -- modify startup options [root @ oradb1 tmp] # vim/boot/grub/menu. lstdefault = 1 timeout = 5 spla Shimage = (hd0, 0)/grub/splash.xpm.gz hiddenmenutitle Red Hat Enterprise Linux Server (2.6.18-274. el5) root (hd0, 0) kernel/vmlinuz-2.6.18-274.el5 ro root = LABEL =/rhgb quiet initrd/initrd-2.6.18-274.el5.imgtitle Red Hat Enterprise Linux Server with MPP surpport root (hd0, 0) kernel/vmlinuz-2.6.18-274.el5 ro root = LABEL =/rhgb quiet initrd/mpp-2.6.18-274.el5.img Node 2 do the same thing 14 share disk partitioning [root @ oradb1 ~] # Fdisk/dev/sdc The number of cylinders for this disk is set to 72815. there is nothing wrong with that, but this is larger than 1024, and cocould in certain setups cause problems with: 1) software that runs at boot time (e.g ., old versions of LILO) 2) booting and partitioning software from other OSs (e.g ., dos fdisk, OS/2 FDISK) Command (m for help): nCommand action e extended p primary partition (1-4) PPartition number (1-4): 1 First cylinder (1-72815, default 1): Using default value 1 Last cylinder or + size or + sizeM or + sizeK (1-72815, default 72815): + 1024 M Command (m for help): nCommand action e extended p primary partition (1-4) pPartition number (1-4 ): 2 First cylinder (126-72815, default 126): Using default value 126 Last cylinder or + size or + sizeM or + sizeK (126-72815, default 72815): Using de Fault value 72815 Command (m for help): wThe partition table has been altered! Calling ioctl () to re-read partition table. Syncing disks. [root @ oradb1 ~] #/Sbin/partprobe view the shared disk in node 2. OK! And 1 node. 15 install and download the asmlib package: http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5-084877.html Check the corresponding version and download and install it: [root @ oradb1 pub] # uname-aLinux oradb1.bdstar.com 2.6.18-274. el5 #1 SMP Fri Jul 8 17:36:59 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux [root @ oradb1 pub] # rpm-ivh oracleasm-support-2.1.8-1.el5.x86_64.rpmwarning: oracleasm-support-2.1.8-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159Preparing... ######################################## ### [100%] 1: oracleasm-support ##### ###################################### [100%] [root @ oradb1 pub] # rpm-ivh oracleasm-2.6.18-274.el5-2.0.5-1.el5.x86_64.rpmwarning: oracleasm-2.6.18-274.el5-2.0.5-1.el5.x86_64.rpm: headv3 DSA signature: NOKEY, key ID 1e5e0159Preparing... ######################################## ### [100%] 1: oracleasm-2.6.18-274.el ####################################### #### [100%] [root @ oradb1 pub] # rpm-ivh oracleas Mlib-2.0.4-1.el5.x86_64.rpmwarning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159Preparing... ######################################## ### [100%] 1: oracleasmlib ####################################### #### [100%] 16 install and configure asmlib as a root user -- use the asm tool to persist the device, of course, you can also use udev for device persistence! -- Both nodes must be configure [root @ oradb1 pub] #/etc/init. d/oracleasm configureConfiguring the Oracle ASM library driver. this will configure the on-boot properties of the Oracle ASM librarydriver. the following questions will determine whether the driver isloaded on boot and what permissions it will have. the current valueswill be shown in brackets ('[]'). hitting <ENTER> without typing anananswer will keep that current value. ctrl-C will abort. default user to own the driver interface []: gridDefault group to own the driver interface []: asmadminStart Oracle ASM library driver on boot (y/n) [n]: yScan for Oracle ASM disks on boot (y/n) [y]: yWriting Oracle ASM library driver configuration: doneInitializing the Oracle ASMLib driver: [OK] Scanning the system for Oracle ASMLib disks: [OK] -- create and configure a single node [root @ oradb1 pub] #/etc/init. d/oracleasm createdisk crs01/dev/sdb1Marking disk "crs01" as an ASM disk: [OK] [root @ oradb1 pub] #/etc/init. d/oracleasm createdisk crs02/dev/sdc1Marking disk "crs02" as an ASM disk: [OK] [root @ oradb1 pub] #/etc/init. d/oracleasm createdisk crs02/dev/sdc1Marking disk "crs02" as an ASM disk: [OK] [root @ oradb1 pub] #/etc/init. d/oracleasm createdisk data01/dev/sdb2Marking disk "data01" as an ASM disk: [OK] [root @ oradb1 pub] #/etc/init. d/oracleasm createdisk data02/dev/sdc2Marking disk "data02" as an ASM disk: [OK] [root @ oradb1 pub] #/etc/init. d/oracleasm createdisk data03/dev/sdd2Marking disk "data03" as an ASM disk: [OK] -- check each node --/usr/sbin/oracleasm is a more advanced oracleasm Command [root @ oradb1 pub] #/usr/sbin/oracleasm listdisksCRS01CRS02CRS03DATA01DATA02DATA03 -- each node register all [root @ oradb1 pub] #/usr/sbin/oracleasm scandisksReloading disk partitions: doneCleaning any stale ASM disks... scanning system for ASM disks... 17 install CVU software on two nodes respectively for # export CVUQDISK_GRP = oinstall # cd/mnt/stage/cvu/cv/remenv # rpm-ivh cvuqdisk-1.0.9-1.rpm 18 check configuration. /runcluvfy. sh stage-pre crsinst-n node1, node2-verbose>/tmp/checkrac.txt