Configuration information:
Use the RGW host with the 2个万 Gigabit network card and do high availability and load balancing with OSPF. Ceph OSD Cluster has 21Node (Gigabit nic + 12 x 4T SATA mechanical HDD)
To test the VM configuration:
Use 8 4-core 8G VMS within a VPC network built with the Vxlan protocol as Cosbench driver. Perform tests at the same time using 128 cosbench work, file block Size (4m-10m).
Test Scenarios and results:
|
Ratio throughput |
Ratio throughput |
Ratio throughput |
Ratio throughput |
|
|
|
|
Read |
80% 2.04gb/s |
20% 268.98 MB/s |
99% 2.34gb/s |
1% 8.8mb/s |
|
|
|
|
Write |
20% 511.94mb/s |
80% 919.69mb/s |
1% 20.62mb/s |
99% 967.05mb/s |
|
|
|
|
Conclusion: RGW read can run full 2 RGW host Gigabit network card, RGW write about 1GB, reach RGW cluster sequential write upper limit (increase RGW host or deploy multiple RGW processes on the host may help to improve writing).
S3workload.xml configuration file:
<?xml version= "1.0" encoding= "UTF-8"? ><workload name= "S3-sample" description= "sample benchmark for S3" > & Lt;storage type= "S3" config= "accesskey=ak;secretkey=sk;proxyhost=;p roxyport=;endpoint=http://rgw-host-ip"/> <workflow><workstage name= "Init" > <work type= "init" workers= "1" config= "Cprefix=s3testqwer"; Containers=r "/></workstage><workstage name=" Prepare "> <work type=" Prepare "workers=" 1 " Config= "Cprefix=s3testqwer;containers=r", Objects=r (1,10); Sizes=u (4,10) MB "/></workstage>< Workstage name= "main" > <work name= "main" workers= "All" runtime= "" ><operation type= "read" ratio= "99" Config= "Cprefix=s3testqwer;containers=u", Objects=u (1,10) "/><operation type=" Write "ratio=" 1 "config=" Cprefix=s3testqwer;containers=u, Objects=u (11,32); Sizes=u (4,10) MB "/> </work></workstage>< Workstage name= "cleanup" > <work type= "cleanup" workers= "1" config= "Cprefix=s3testqwer;containers=r (Objects=r (1,32) "/></workstage><workstage name=" dispose "> <work type=" Dispose "workers=" 1 " Config= "Cprefix=s3testqwer;containers=r"/></workstage> </workflow></workload>
Cosbench Test:
Cosbench pressure measurement RGW production environment