ORACLE RAC Installation-performance and high-availability testing

From the 11G onwards, the installation of RAC has become a physical work, but after the completion of RAC installation, how to ensure the stable operation of the system, how to get the performance of the system, this is the stability of the late-line system operation has a huge impact.

The following is a summary of the recent 1 years of engineering implementation of some of the experience.

###################################################################################

# # 0. Environmental inspection

# # 1. IO Performance test

# # 2. Network Performance Test

# # 3. Highly Available tests

# # 4. HP-UX Hardware view commands

# # 5. Log Collection

# # Note: This document is based on the HP-UX platform, please refer to the platform corresponding operation command

###################################################################################

===================================================================================

# # 0. Environmental inspection

===================================================================================

-----------------------------------------------------------------------------------

# 0.1 System time/time zone

-----------------------------------------------------------------------------------

# date

# Cat/etc/timezone

# Cat/etc/default/tz

# echo $TZ

-----------------------------------------------------------------------------------

# 0.2 Detecting kernel parameters/asynchronous io/network parameters

# async IO file permissions The correct value is: Oracle/oinstall 660 101 0x000104/dev/async

-----------------------------------------------------------------------------------

--hp

# Kctune | Sort

# Ls-la/dev/async

# cat/etc/rc.config.d/nddconf

# NETSTAT-INW

--linux

# Sysctl-a | Sort

-----------------------------------------------------------------------------------

# 0.3 mutual trust Check

-----------------------------------------------------------------------------------

$ more/etc/hosts | Grep-ev ' ^#|^$|127.0.0.1|vip|scan|: ' | awk ' {print ' ssh "$" date; "} ' > ping.sh

$ sh./ping.sh

-----------------------------------------------------------------------------------

# 0.4 Cluster Status check

-----------------------------------------------------------------------------------

# CRSCTL Stat res-t

# olsnodes-n-i-s-T

# olsnodes-c

# oifcfg Getif

-----------------------------------------------------------------------------------

# 0.5 Check Instance run status

-----------------------------------------------------------------------------------

Sql>

Set Linesize 160;

Select Inst_id,instance_name, To_char (Startup_time, ' yyyy-mm-dd hh24:mi:ss ') start_time, status from Gv$instance;

-----------------------------------------------------------------------------------

# 0.6 Check ASM DG Capacity

-----------------------------------------------------------------------------------

Sql>

Select Group_number,

Name

State

Type

ROUND (total_mb/1024, 2) TOTAL_GB,

ROUND (free_mb/1024, 2) FREE_GB,

Round ((TOTAL_MB-FREE_MB)/(Case TOTAL_MB

When 0 Then

1

Else

Total_mb

END) * 100,

2) ratio

From V$asm_diskgroup;

===================================================================================

# # 1. IO Performance test

===================================================================================

-----------------------------------------------------------------------------------

# 1.1 Calibrate_io Test

-----------------------------------------------------------------------------------

SELECT D.name,

I.asynch_io

From V$datafile D,

V$iostat_file I

WHERE d.file# = I.file_no

and i.filetype_name = ' Data File ';

--enabled both direct I/O and asynchronous I/O where possible.

ALTER SYSTEM SET Filesystemio_options=setall scope=spfile;

SET Serveroutput on

DECLARE

L_latency Pls_integer;

L_iops Pls_integer;

l_mbps Pls_integer;

BEGIN

Dbms_resource_manager. Calibrate_io (num_physical_disks = --Number of disks select COUNT (1) from V$asm_disk;

max_latency =--Max delay

Max_iops = L_iops,

max_mbps = l_mbps,

Actual_latency = l_latency);

Dbms_output.put_line (' Max IOPS = ' | | l_iops);

Dbms_output.put_line (' Max MBPS = ' | | l_mbps);

Dbms_output.put_line (' Latency = ' | | l_latency);

END;

/

--Monitor the rate of IO and HBA cards

# sar-h 2 10000

-----------------------------------------------------------------------------------

# 1.2 Fio Test

-----------------------------------------------------------------------------------

===================================================================================

# # 2. Network Performance Test

===================================================================================

-----------------------------------------------------------------------------------

# 2.1 Netperf Test

-----------------------------------------------------------------------------------

Cd/usr/contrib/bin/tools

--Server Side

# netserver-4-L 192.168.30.76-P 8000

--Client

# netperf-h 192.168.30.76-p 8000-n 20-l 60

--Test UDP packet

# netperf-t Udp_rr-h 192.168.30.76-p 8000-l---R 1500 1500

# netperf-t Udp_rr-h 192.168.30.76-p 8000-l---R 9000 9000

-----------------------------------------------------------------------------------

# # 2.2 Iperf test, Linux for IPERF3

-----------------------------------------------------------------------------------

--Server Side

# Iperf-s-P 5001-i 2

--Client

# iperf-c 192.168.30.76-p 4-t 30-i 2-p 5001

-----------------------------------------------------------------------------------

# # 2.3 FTP rate Test

-----------------------------------------------------------------------------------

Ftp> put "|dd if=/dev/zero bs=32k count=10000"/dev/null

-----------------------------------------------------------------------------------

# 2.4 Mut test for 9000 (tcpdump requires root privileges)

-----------------------------------------------------------------------------------

--lan902 Heartbeat NIC

--192.168.20.67-to-end heartbeat NIC Address

--from the node by accessing the other's heartbeat IP to establish a TCP connection, then look at the TCP packet caught above to see the MSS value. If 8960, the MTU is 9000.

--Package test via netperf or ping, with ICMP length of 8976

Cd/usr/contrib/bin/tools

# tcpdump-i lan902 IP host 192.168.20.67

# telnet 192.168.20.67 22

# netperf-h 192.168.20.67-p 8000-n 20-l 60

# ping 192.168.20.67 9000

===================================================================================

# # 3. Highly Available tests

===================================================================================

-----------------------------------------------------------------------------------

# 3.1 Storage Link Test

# View the status of the link disabled and endable in the operating system log to view HBA card data traffic information

# view Disk Link aggregation conditions

# During the storage link test, the Dbms_resource_manager is turned on all the way. Calibrate_io for pressure

-----------------------------------------------------------------------------------

--Confirm Device link

# ioscan-m Dsf/dev/rdisk/disk101

# tail-f/var/adm/syslog/syslog.log

# sar-h 2 10000

-----------------------------------------------------------------------------------

# 3.2 NIC/switch test

# View the cluster logs for network outages, view ASM alert logs (grid user)

# Check the NIC aggregation, check the network card log to see if the packet is dropped

# During the network test, the whole process opens Netperf package for pressurization

-----------------------------------------------------------------------------------

grid$ CD $ORACLE _home/log/' hostname '/; TAIL-F alert ' hostname '. log

grid$ CD $ORACLE _base/diag/asm/+asm/$ORACLE _sid/trace; Tail-f Alert_$oracle_sid.log

# glance L

# nwmgr-s Apa-c lan902-v

# cd/var/adm; Netfmt-f Nettl. LOG000

# ping IP

===================================================================================

# # 4. HP-UX Hardware view commands

===================================================================================

-----------------------------------------------------------------------------------

# # 4.1 Viewing devices

-----------------------------------------------------------------------------------

--FC Equipment

# IOSCAN-FNCFC

--Network card device

# Ioscan-fnclan

-----------------------------------------------------------------------------------

# 4.2 View FC Device status

-----------------------------------------------------------------------------------

# FCMSUTIL/DEV/FCD1

-----------------------------------------------------------------------------------

# 4.3 view disk multipath information

-----------------------------------------------------------------------------------

# ioscan-m Dsf/dev/rdisk/disk101

-----------------------------------------------------------------------------------

# 4.4 Viewing network card information

-----------------------------------------------------------------------------------

# LANSCAN-QV

# NETSTAT-INW

-----------------------------------------------------------------------------------

# 4.5 Viewing NIC binding information

-----------------------------------------------------------------------------------

--NIC binding information

# nwmgr-s Apa-c lan902-v

--Network card priority

# nwmgr-g-A all-c lan5-s APA

===================================================================================

# # 5. Log Collection

===================================================================================

-----------------------------------------------------------------------------------

# # 5.1 ASM log (GRID)

-----------------------------------------------------------------------------------

CD $ORACLE _base/diag/asm/+asm/$ORACLE _sid/trace; Tail-f Alert_$oracle_sid.log

-----------------------------------------------------------------------------------

# # 5.2 Cluster log (GRID)

-----------------------------------------------------------------------------------

CD $ORACLE _home/log/' hostname '/; TAIL-F alert ' hostname '. log

-----------------------------------------------------------------------------------

# 5.3 Database log (Oracle)

-----------------------------------------------------------------------------------

CD $ORACLE _base/diag/rdbms/' echo ${oracle_sid%?} '/$ORACLE _sid/trace; Tail-f Alert_$oracle_sid.log

-----------------------------------------------------------------------------------

# # 5.4 OS log (root)

-----------------------------------------------------------------------------------

Tail-f/var/adm/syslog/syslog.log

-----------------------------------------------------------------------------------

# # 5.5 Network card log (root)

-----------------------------------------------------------------------------------

Cd/var/adm; Netfmt-f Nettl. LOG000

ORACLE RAC Installation-performance and high-availability testing