Database Benchmarking Description

1 TPC Overview

When the database and the server stress test or contrast, often use HAMMERDB or benchmark tools, and the most commonly used TPCC standards for testing.

Here's the TPCC, the first 3 letters are: TPC is transaction Processing Council (transaction Committee), which provides quantitative methods and standards.

So the TPCC we're talking about is one of the test methods.

TPC's official website is: http://www.tpc.org/

As can be seen from the diagram, there are many other methods besides tpc-c, including abandoned tpc-a,tpc-b,tpc-d,tpc-r,tpc-w.

The differences between the different test methods can be directly clicked on the official website instructions.

2 Description of benchmarking on Oracle website

The following is directly from Oracle's website, the original address no longer exists, the article tells the database benchmarking reasons, standards, and several measurement tools software.

2.1 Reasons for Benchmarking

Benchmarks is performed for Variousreasons. However, benchmarks is primarily used:

* To compare different hardware configurations

Benchmarks can used to compare the relative performance Ofdifferent hardware running the same application. This was generally used to directly compare hardware configurations between.

* To compare different database vendor software

By running the same benchmark usingdifferent database software on the same machine, one can easily compare betwee Ndifferent database vendors. This was generally usedto make a price/performance decision between vendors such as Oracle, Microsoft, IBM , etc.

* To compare different database software releases

Similar to the above, one can use different versions of the Samevendor'sdatabase software to compare the one they wan T to use or checkfor performance regressions due to upgrades (i.e. 10g vs. 11g).

2.2 Real World Benchmarks

While there areseveral industry standard benchmarks, most of the time, they don' Treflect a company 's actual workl Oad. As such, you'll often findcustom benchmarks being performed. The goals of a Real-world benchmark is thesame reasons mentioned above.

2.3 Industry Standard Databasebenchmarks

Industrystandard benchmarks is generally used by businesses to compare differenthardware and software system performance for purchase-related reasons. While industry standard benchmarks is modelled afterreal-world workloads, they rarely reflect a company' s Realworkloa D. However, it is a quick-to-compare the performance of varioushardware and software combinations operating in a well- Defined scenario. Themajor industry standard benchmarks is listed below.

2.4 Transaction Processing Council (TPC)

The TPC is Anon-profit Corporation which supports a consortium of hardware and Databasesoftware vendors devoted t o Defining transaction processing anddatabase-related benchmarks. The primary goal behind TPC benchmarks is thedefinition of functional requirements which can be run on any Databa Se,regardless of the hardware or operating system. This allows vendors toimplement their own benchmark kits on order to satisfythe functional requirements. Similarly, after have publicly submitted proofthat a benchmark is conducted according to the specification, end-users H Avemore of an assurance the what they was presented with is Avalid, apples-to-apples comparison.

2.4.1 Tpc-b

The Tpc-b benchmark stresses databases and is characterizedby significant disk input/output, moderate system, application  Execution Time,and Transaction integrity.  Thisbenchmark Targets database management systems (DBMS) batch applications, andback-end database servers. Tpc-b is Notan OLTP benchmark.

2.4.2 TPC Benchmark C (tpc-c)

The tpc-c simulates an order-entryenvironmentwhereApopulation of terminal operators executes transactions against a database. Thebenchmark isComprised of transactions which include entering and deliveringorders, recording payments, checking the status of orders, and monitoring thelevel of the stock at the warehouses. The most frequent transaction consists ofentering aNewOrder which, on average, isComprised of ten different items. Each warehouse tries to maintain stock forThe -, theItemsinchThe company' s catalog and fill orders from Thatstock. The performance metric reported by TPC-C measures the number of ordersthat can being fully processed per minute and is Expres Sed in tpm-c. The Tpc-cwill soon is deprecated in favor of the TPC-E.

2.4.3 tpc-d

The tpc-d benchmark represents a broad range ofdecision support (DS) applications that require complex, and long runningqu Eries against large complex data structures. Real-world business questions were written against the model, andresulted in complex queries.

2.4.4 TPC Benchmark E (TPC-E)

The TPC-E benchmark simulates the OLTP workload of a brokeragefirm. The focus of the benchmark is the centraldatabase so executes transactions related to the firm ' s customer accou Nts. The TPC-E metric is given in transactions per second (TPS). It specifically refers to the number Oftrade-result transactions the server can sustain over a period of time.

2.4.5 TPC Benchmark H (tpc-h)

Thetpc-h is adecision support benchmark which consists of several business-oriented ad-hocqueries and concurrent data Modi Fications. This benchmark illustrates Decisionsupport systems the examine large volumes of data, execute queries with a highdegree o f complexity, and give answers to critical business questions.

The Performancemetric reported by Tpc-h are called the tpc-h Composite query-per-hourperformance Metric ([email protected]) , and reflects multiple aspects of the capabilityof the system to process queries.

2.5 Standard Performance evaluationcorporation (SPEC)

2.5.1 free and Open Source Benchmark Kits

As the benchmarkkits used by various database vendors is proprietary, several open SourceDatabase benchmark kits has bee n written to implement isn't only the Industrystandard workloads and others as well.

* Open Source Development Labs Database Test Suite

The OSDL DBT Suite is the mostcomprehensive of all open source benchmark kits. While its benchmarkimplementations is based on TPC standards, they differ in Someareas and is not certified; Making a comparison between a certified Tpc-cresult and OSDL' s implementation of tpc-c (DBT-2) impossible. As the originalosdl DBT Suite lacks Oracle support, Oracle have added and released it as partof the Oracle Linux Test kit.< /c4>

* Poleposition

Poleposition is a open sourcebenchmark test suite to compare database engines and object-relationalmapp ING technology.

* JTPCC

JTPCC is an open source Java implementation ofthe TPC-C benchmark. While the IT claims compliance with TPC-C, it's not.

* Benchmarksql

Benchmarksql is a open source,easy to use JDBC benchmark which closely resembles the tpc-c Oltp;it was originally based on JTPCC.

* Bristlecone

Bristlecone is a simpleselect+insert/update/delete throughput and Response-time benchmark written in Java.

* Fintime

Fintime is a open source set ofdata and queries which reflects the needs of financial analysts who Ares tudying patterns in stock market data, but it should appealto the designers of any system that have pretensions of Handling ordered Datawell.

* Java TPC-W implementation

This Open-source implementation is BasedOn the TPC-W Specification version 1.0. 1. Itstrays from the official benchmark specification in a fewminor areas, which is specified in 4> documentationincluded with the distribution. This version of itself lacks Oracle support, butit can is found on the web.

* Swingbench

Swingbench is a free loadgenerator (and benchmarks) designed to stress test an Oracle database (9i,10g,11g).

* OpenLink ODBC Bench

OpenLink ODBC Bench is an OPEN-SOURCEODBC benchmarking tool providing real-time comparative benchmarking for< /c1> odbcdrivers, Database Engines, and Operating Systems combinations. The benchmarks in this application is loosely based on the tpc-a and TPC-C standard benchmarks, Withmodi Fications to specifically test the performance of an ODBC Driver and/ordatabase Engine in a client/server environ ment.

* OpenLink JDBC Bench

Similar to OpenLink'sODBC Bench, this is a JDBC version.

* Tpcc-uva

A free, Open-source implementation of the Tpc-c Benchmark.

* Hammerora

An open source load generation tool.

2.5.2 Commercial Benchmark Kits

There is several industry standard benchmarks.

* Official Oracle Benchmark Kits

Similar to Microsoft and IBM, the official benchmark kits used byoracle can is only obtained under certain conditions. For more information,contact your Oracle consulting/partner/support representative.

* Real Application Testing

While many wouldn' t think of Real application testing ASA traditional Benchmark kit, it does perform workload executio N primarily forthe real world benchmarking case.

* Quest software' Sbenchmark Factory for Databases

Benchmark Factory for Databases are aworkload simulation and scalability testing tool that stress tests Y Ourenvironment by simulating users and transactions on the database. You caneither replay production workload or use synthetic workload to test the Limitsof your database.

* SPEC jappserver Benchmark Kit

This can is acquired directly from SPEC.

2.6 benchmarking-related Books

There is several good books regarding benchmarking. The best I' vefound include the following:

* The Benchmark handbook:for Database andtransaction processing Systems (Jim Gray)

A great, albeit outdated book. While several of the benchmarks itdiscusses has been deprecated, it presents good concepts and backgroundinformation Rega Rding Benchmarking.

* Performance analysis of Transaction Processingsystems (Wilbur H. Highleyman)

While out of print, this bookpresents both Plain-text and math-heavy concepts of queueing and Performanc Eanalysis techniques oriented for OLTP.

* Database benchmarking:practical Methods for Oracle & SQL Server

This book explores all aspects of the database benchmarking and showsyou a real-world approach that ensures that is PREPA Red for whatever the future brings to your mission-critical database.

--------------------------------------------------------------------------------------------

All rights reserved, the article prohibits reprint, otherwise investigates the legal liability!

Aboutdave:

--------------------------------------------------------------------------------------------

qq:251097186

Email: [email protected]

Blog:http://blog.csdn.net/tianlesoftware

Weibo:http://weibo.com/tianlesoftware

Twitter:http://twitter.com/tianlesoftware

Facebook:http://www.facebook.com/tianlesoftware

Linkedin:http://cn.linkedin.com/in/tianlesoftware

Dave's QQ Group:

--------------------------------------------------------------------------------------------

Note: Add group must indicate tablespace and data file relationship | Do not repeat the addition group

cndba_1:104207940 (Full) cndba_2:62697716 (full) cndba_3:283816689

cndba_4:391125754 cndba_5:62697850 cndba_6:62697977 cndba_7:142216823 (full)

Description of the database Baseline test Benchmarking