Research on key technologies of cloud storage System

Research on key technologies of cloud storage System

Chaofeng of Zhengzhou University

This paper studies the architecture of general cloud storage system, and gives a method of processing mass small files based on Hadoop. The main contents of this paper are as follows: On the basis of in-depth analysis of HDFS, the characteristics of general cloud storage System are considered comprehensively, and a cloud storage system architecture is proposed to improve storage efficiency. Based on the processing method of HDFs medium and small files at home and abroad, using two-dimensional boxing algorithm and dynamic optimization idea, a small file processing algorithm is designed to preprocess small files in HDFs and improve the response speed of the system. The experiment shows that the proposed method of small file processing can effectively improve the utilization rate of resources and the response speed of the system. The design realizes a cloud storage prototype system based on college application environment, which separates object content and object metadata, and adopts multi region architecture model. The prototype system verifies the rationality and effectiveness of the proposed cloud storage system architecture.

Research on key technologies of cloud storage System