How high is the performance of NVME devices?

NVMe SSDs are the evolution direction of storage disks, and NVMe SSDs have more than ten times the performance growth compared to SATA/SASSSD. This is mainly due to the NVMe SSD Multi-queue technology, through the multi-queue technology can be IO access parallelization, so as to improve the overall performance of the system.

in theNVMein the storage ecosystem,Ssdstechnology has become very mature. Intel,Samsungas wellMemblazecompanies have already launched a complianceNVMeStandard ofSsdsproducts. On the server side, ultra-micro-2015It was launched at the beginning of the year.10Disk PositionNVMeserver, and in2016at the beginning of the year launched the support24as well48the full disk positionNVMeserver. DELL, Wave, Lenovo and other server manufacturers are generally supported4~8Disk PositionNVMe SSD, can sayNVMe SSDwill be a standard configuration in the server. On the network side, supportROCEtechnologies such as high-performance Ethernet networks have become more matureIserSuch protocols can support remote export of storage volumes. So, from a hardware point of view,NVMeThe storage ecosystem is already in place. A lot of people are thinking aboutNVMestorage, often there is a doubt, in the endNVMe SSDwhat level of performance can be achieved at the system level?

650) this.width=650; "src=" http://s4.51cto.com/wyfs02/M02/8A/FC/wKiom1hAJTGwg6CJAABxD7ZgUN8563.jpg "style=" float: none; "title=" 1.jpg "alt=" Wkiom1hajtgwg6cjaabxd7zgun8563.jpg "/>

for Flixbox NVMe SSD Performance You must be very clear. An ordinary 1.6TB NVMe SSD, after aging processing, random read performance can easily reach more than million ioPS ; Random write performance can be maintained in the iops The sequential read bandwidth can be above 2.5gb/s , and the sequential write bandwidth remains above 1.2gb/s. This single-disk performance goes well beyond traditional disks and Sata/sas SSDs. So what happens when you configure multiple disk NVMe SSDs in one server ? What are the factors associated with overall performance?

in the case of an ultra-micro server, you can take a peek at system-level performance constraints. the relationship between SSD and CPU can be described as shown in the serverof the ten -disk NVMe SSD:

650) this.width=650; "src=" http://s1.51cto.com/wyfs02/M01/8A/FC/wKiom1hAJTKi1yMMAACSL13nLoo361.jpg "style=" float: none; "title=" 2.jpg "alt=" Wkiom1hajtki1ymmaacsl13nloo361.jpg "/>

in this structure, we can see NVMe SSDs are directly connected to the CPU fan-out PCIe Lane , which is the lowest latency. In the case of server configuration e5-2699 V4 processor, the overall maximum random read performance can reach more than million IOPS . that is to say, the performance of the disk can be fully played out. compared to the equivalent of a ten -disk SAS SSD device, the overall performance is increased by more than three times, as shown in the comparison results. The results are perfect, but need to perform such a high performance, or need to be equipped with the e5-2699 Super processor.

650) this.width=650; "src=" http://s1.51cto.com/wyfs02/M02/8A/F8/wKioL1hAJTKQsxmgAAB5LXRpujU542.jpg "style=" float: none; "title=" 3.jpg "alt=" Wkiol1hajtkqsxmgaab5lxrpuju542.jpg "/>

for the NVMe server with a disk bit ,the relationship between SSD and CPU can be described as shown:

650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M00/8A/FC/wKiom1hAJTOCOBsyAACyUGCJi3U919.jpg "style=" float: none; "title=" 4.jpg "alt=" Wkiom1hajtocobsyaacyugcji3u919.jpg "/>

This structure differs from the ten -bit server, in order to connect more SSDs, a PCIe switch is introduced between theprocessor and the SSD,through which the switch Expand on more SSDs. The benefit of this is to increase the number of SSD connections, but the problem introduced is that it limits IO performance. In the server, the overall performance of the disk server is not high, the maximum random read performance of up to 470 million IOPS, The disk server is a bit lower. The reason for this is that the PCIe Switch causes the delay to increase, on the other hand , the number of PCIe ports that the CPU connects to the SSD drops. It seems that the system level is not the more the better, the key is to look at the system architecture.

650) this.width=650; "src=" http://s5.51cto.com/wyfs02/M00/8A/F8/wKioL1hAJTPjs5PWAACHgYQz2Dg888.jpg "style=" float: none; "title=" 5.jpg "alt=" Wkiol1hajtpjs5pwaachgyqz2dg888.jpg "/>

the system architecture is similar to that of the disk-bit NVMe server. The difference is the introduction of more PCIe Switch, as shown in the system structure:

650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M01/8A/F8/wKioL1hAJTSCNQEmAACcCSdSdIM031.jpg "style=" float: none; "title=" 6.jpg "alt=" Wkiol1hajtscnqemaacccsdsdim031.jpg "/>

Compared with the disk server,the performance of the disk is improved, but the change is not small, and the same level of SAS SSD server compared to the results as shown:

650) this.width=650; "src=" http://s5.51cto.com/wyfs02/M02/8A/FC/wKiom1hAJTTSa-quAAB8GkbWST0963.jpg "style=" float: none; "title=" 7.jpg "alt=" Wkiom1hajttsa-quaab8gkbwst0963.jpg "/>

use multiple disks at the system level SSD, on the onehand requires server platform support, different server platform determines the performance of the upper limit. On the other hand, software support is indispensable, and the efficiency of software often has a great impact on the overall performance of the system. In the NVMe storage domain, the current software is not quite complete and lacks a software system similar to disk storage. In the case of FlashRAID, the software is a data protection system for NVMe SSDs, which manages four NVMe SSDs and implements a data protection mechanism similar to RAID5. In this case, as shown, the random read performance can exceed the IOPS of millions. We found that with the further increase of NVMe SSD , the overall performance of the system has increased, but the performance loss caused by the software is unavoidable due to the ability of CPU.

650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/8A/F8/wKioL1hAJTWwnUy_AAD4XXmMOCg899.jpg "style=" float: none; "title=" 8.jpg "alt=" Wkiol1hajtwwnuy_aad4xxmmocg899.jpg "/>

we can foresee NVMe SSDs are the next generation of mainstream storage media, not only with ultra-high performance, but also with extremely high storage capacity, ideal for enterprise-class storage applications. In the process of NVMe ecological step- by-step improvement, we also found that the system software still has a lot of development space. The system performance of NVMe SSDs depends on the design architecture of the server, and on the other hand, the storage core software stack.

This article is from the "Save the Way" blog, make sure to keep this source http://alanwu.blog.51cto.com/3652632/1878680

How high is the performance of NVME devices?