Research on distributed storage and security protection of massive data

Research on distributed storage and security protection of massive data

Shandong University Chao Songnan

Based on the research of the security strategy of distributed data and information storage, this paper designs a kind of storage model and query mechanism for the distributed platform, which is suitable for large data, and can provide data sharing integrity check function. Firstly, based on the architecture and principle of the open source Hadoop distributed Data File System (HDFS) and the symmetric encryption algorithm and public key cryptosystem, this paper presents a HDFS distributed data security storage model. The model uses HDFS and XML format as the storage environment and physical structure of data files, which can not only solve the storage problem of large data, but also provide data access control (DAC) to data files. The experimental results analyze the time of data encryption and decryption, and the bandwidth performance of data uploading and downloading in the Distributed data file system. Second, distributed data file sharing storage in order to ensure data security, it is necessary to make periodic key modification and provide effective key management method. This paper studies the characteristics of the Chebyshev polynomial and the key management of Lkh key tree, and proposes a method of periodic multicast key modification based on Chebyshev polynomial and Lkh key tree. Compared with the original Lhk method, this method is suitable for the key modification of distributed large data platform, and it improves the efficiency and security. Thirdly, the concepts and platforms of Bloom filter algorithm and map reduce programming are studied. The method of combining Bloom filter and distributed map reduce programming is used to improve the performance of ciphertext query, and the idea of layered bloom filter is proposed on the basis of original Bloomfilter. The experiment further shows that using the Layered Bloom filter algorithm can reduce the error rate of the data to a certain extent. Finally, a distributed data file storage and query system is designed and implemented. The system can realize the function of encrypting and uploading the original data, decrypting and downloading, sharing, key management and ciphertext query. At the same time, the system uses B/s system structure, the user interface is good, operability is strong.

Research on distributed storage and security protection of massive data