Summary of several performance test software for Linux file system

Once testing the performance of the distributed cluster system under the Linux system, using some test software, the company let me give the department colleague to do a basic training, and then look at the previous written records selected a few of them, the memory is not complete, only record the use of functions.

1.Iozone

IOzone is a file system benchmark tool that can test the read and write performance of file systems in different operating systems.

Can test read, write, re-read, re-write, Readbackwards, Read strided, Fread, fwrite, Random Read, Pread, Mmap, AIO_READ,AIO_WR Ite and so on different modes of the performance of the hard drive.

Test parameters:-I # used to specify the test content, I mainly use the following two kinds:

0=write/rewrite

1=read/re-read

For example Test write:-I 0, test read and write:-I 0-i 1.

-r generates output log in EXECL format

-B will produce a binary execl log file name

The file size of the-s test

-R File Block size

-A is tested on the desired file system, but only a is fully tested and takes a long time, preferably using-I to specify the test scope.

Shows a IOzone test ext3 part of the local file system results, the size of the test file is 1m, the size of the test file is 4G, the test includes the closing time of the file and the flush time, the test content contains write/rewrite, read/reread, and the binary log generated during the test is saved in/ Test.xls in the home directory.

Typically, the test file size requirement is at least twice times the system cache, so the results of the test are truly credible. If it is less than twice times the cache, the read/write test of the file will be the cache speed and the result of the test is greatly compromised.

2.Mdtest

Mdtest is a tool for testing the performance of file system metadata.

We often use the meaning of some parameters:

-D Test Run Directory

-I test cycle times

-N the number of directories and files each process will create/count/delete

How many bytes are written after the-W file is created

Time delay before-P loop

-D test only for the catalog

-F test only for files

is a mdtest test result, the test parameters are: The test run directory is/MNT/AAA, create/Count/delete directory and the number of files is 30000, repeatedly executed 3 times.

The maximum number of operations per second that can be seen from the catalog creation is 7016.495, the average number of operations per second can be 6691.628, and the maximum number of operations per second that the file creation can complete is 63521.371, and the average number of operations per second can be 62325.578 times. (Because the test is local file system, so the value is larger)

3.Simul

Simul is a parallel file system testing tool that can simultaneously simulate multiple nodes and processes to perform file system operations to test the accuracy and consistency of a parallel file system.

Main parameter meaning:

-D test the directory that will run

-F Test Number when starting test (default is 0)

-L test number at the last Test (default is 39)

Test number included in the-I testing process

Test numbers that are not included in the-e test process

-N number of repetitions per test

-n the number of repetitions of all tests

The test directory is /mnt/aaa/, the test executes all tests from 0 to 39, the test result is all test passed!

4.Fdtree

Fdtree is a tool for testing the performance of file system metadata and can also be used for stress testing.

Parameter meaning:

-C Create a directory tree only

-D Open Debugging

-R only removes the directory tree

-L Create a recursive level of the directory, default to 4

-d The number of directories to create for each level

-F Number of files to be created per directory

-O path name when testing starts

-S file size (based on block, Linux block size is 4096Bytes), default is 10

Fdtree.bash–d 1–l 2–f 10000–s10000

This example is a file pressure test, the creation of the directory structure of the hierarchy of 2, each level to create 1 directories, each directory under the number of files is 10K, each file size is 10000*4096BYTES=40.96MB, the total data size is 2*10000*40.96mb= 819.2GB.

fdtree.bash-d 10000-l 100

This example is a catalog stress test that creates a directory structure with a rating of 100, and the number of directories under each level is 10K. The number of total directories under the first level is 10K, the total number of total directories under the second level is 10k*10k, the number of total directories under the third level is 10k*10k*10k, and so on!

Show a fdtree test results, directory level 5, the number of directories created under each level is 5, the number of files in each directory is 5, the file size is 40KB.

Summary of several performance test software for Linux file system