Wave mass Storage AS3000 application case in telecom industry

Recently, the Wave store released the cloud computing architecture under the basic storage module-as3000 mass Storage System successfully applied to the Shandong Institute of Information and communication technology animation and rendering cluster system construction, for the customer information construction to build a solid information hardware platform to meet the customer integration high-end applications, To ensure that the massive data stable operation demanding demand. In this project, the mass storage scheme built by tidal mass storage AS3000 is one of the largest rendering cluster system, which has pioneered the high-end application of mass storage.

With the animation production industry in the domestic rising, "rendering farm" began to be widely popular in the industry. The so-called rendering farm is actually rendering the cluster, it will be a large number of rendering tasks split into multiple tasks, and then submitted to the network of other servers to render, the final rendering of the dataset stored in a designated storage directory, and then by the production staff call. However, in a standard rendering hardware platform, the bandwidth between the rendering server and the storage system tends to be a bottleneck in rendering performance.

Shandong Institute of Information and Communication technology is a scientific research institution formed by Shandong Provincial People's government in the national Information and Communication International Innovation Park, which undertakes the construction, maintenance, operation and management of scientific research facilities, and coordinates scientific and technological resources to achieve the most effective integration of resources is its main responsibility. In the application of this project, how to choose the high efficiency storage system, satisfy the high bandwidth demand of customers, satisfy the request of the data storage submitted by many rendering clients, reduce the time of rendering as much as possible, is the urgent problem that Shandong information and Communication Technology research institute needs to solve.

Project programme:

First of all, wave storage engineers in-depth analysis of the user has built a set of animation rendering cluster scheme, to understand the system at that time a series of problems: poor compatibility, unable to expand. Then analysis that users need to choose High-performance Rendering cluster scheme, to adopt advanced storage architecture to improve the existing system, the improved storage system should be compatible with the original storage equipment, and the improved system should be able to meet the large-scale rendering, special effects editing, such as high bandwidth requirements for data storage. Finally selected the wave of the latest cloud storage, high-performance cluster architecture storage products AS3000 to the storage system to upgrade the overall transformation. As shown in the following illustration:

This scheme configures a set of 8-node AS3000 system, chooses a high-performance All-fiber architecture disk array, and uses the original wave AS1000G2 storage of the customer as AS3000 back-end storage node. AS3000 is a fully modular structure design, which supports the online upgrade of data node machine storage nodes, and can easily realize the requirement expansion of modules.

In this project, through the use of tidal wave AS3000 mass storage System, user data directly through the Storage Control node scheduling, data nodes will be written to the back-end storage node. The data storage mechanism is stored in a single file through a data node to the back-end of the LUN, at the same time the task occurs by the control node unified dispatch by the task of the data node into the corresponding LUN, so that the multiple data node concurrent read and write, improve the overall performance of the system. The whole scheme adopts full redundancy design, there is no single point of failure problem, fully protect the customer data security, through the million gigabit network to provide high-performance work support platform, to meet the animation rendering, high-definition non-linear editing and other animation production work, and for the future to increase the task to provide expansion capabilities. Through AS3000, the problem of load balancing of large data reading and writing is solved, and the system computing ability is effectively improved, and the system performance expansion is supported in the future. In addition, AS3000 Gigabit host Interface configuration can provide high bandwidth, support high IOPS; The cloud storage Unified Storage Pool provides unlimited scalability to meet customer needs.

Programme features:

System availability and high reliability design:

All nodes in the cluster system are in working state, and the tasks are distributed evenly to each node, and when one node fails, the task is automatically distributed to other nodes.

The system is designed in two aspects, such as hardware and software, so as to ensure that the system runs 7*24 hours without interruption and the key data is not lost.

Second, the system scalability:

The system supports both vertical and horizontal extensions. The so-called longitudinal, refers to the system capacity expansion to the PB level or even higher. Horizontal, refers to the increase in the number of equipment, such as data nodes using 4, the latter can be extended to 6, 8, the expansion of the way more flexible. The scheme is mainly expressed in two aspects: the system storage capacity can be extended, and the system IO bandwidth can be extended.

Third, the system easy to maintain and ease of use:

The AS3000 control interface adopts a friendly full Chinese web display, and the administrator does not need to undergo long-term professional training, only a few hours can master the operating process of AS3000, provide the storage System State monitoring, event management, storage system failure email alarm mechanism.

In the fierce competition throughout the project, the wave of a new generation of massive AS3000 storage system through the excellent technical can finally get the full recognition and trust of customers, stand out as winners, build a wave mass storage AS3000 as the core of the animation rendering cluster scheme to meet the customer large-scale rendering, High bandwidth requirements for data storage, such as special effects editing.

AS3000 Technology analysis of mass storage products:

Wave mass storage products AS3000 came out, although some people think he is high in the clouds, the ability is high but mysterious unpredictable, but also have a lot of doubts and confused voice. In fact, in the domestic high-end storage market, AS3000 for the first time is to compete with world-class high-end storage products to raise the flag, this state of appearance is very normal. The domestic high-end storage product market has been monopolized by several foreign manufacturers, but in recent years, the tide has led to set up a mass storage standards committee and mass Storage Alliance in the storage industry in the most influential organizations, at the same time relying on the national level of mass storage research and development platform, carried out a continuous technical tackling, and gradually began to break the monopoly of foreign manufacturers.

AS3000 mass Storage System using cluster architecture design, optional InfiniBand or Gigabit host interface, efficient internal fiber-optic switching network and unified large-capacity PB-level storage space, you can see that the overall design does not exist any performance bottlenecks, can fully meet the performance of the storage system horizontal and vertical smooth expansion. In addition, the wave AS3000 adopts control node and data node to separate the host architecture, single two control nodes and two data nodes, control the data storage control and management of the node, do not occupy the data I/O performance resources, data nodes store the data in the back-end storage pool through the efficient internal ray network. Perfect match before and after performance, to meet the high concurrent access to provide hardware support, so that the entire system hardware platform to the ultimate performance. The back-end storage pool supports a variety of hard disk expansion, can be based on their own performance and cost requirements, the use of ssd,sas,sata. Fully meet the customer animation cluster data storage platform for the later expansion of the demand.

Wave mass Storage AS3000 has a wide application market in aerospace, meteorology, High-performance computing, large-scale network game centers, television media editing and animation production, securities and banking industries. The high-end mass storage AS3000 successful application, marking the wave of storage has taken the first step of leapfrog development, as the leader of domestic storage brands, wave storage will be the most advanced technology and the best service to the vast number of users, to help more customers to achieve the steady development of information technology industry.