Research on heterogeneous large data storage method

Research on heterogeneous large data storage method

Beijing Jiaotong University Tanxu

The main research contents include the following aspects: first of all, in view of the emergence of large data and the challenges posed, from a technical point of view of the development of the non-relational database. In general, the characteristics of relational database and non relational database are compared, this paper analyzes the advantages and disadvantages of the relational database and the bottleneck in the large data environment, deeply studies the structure, theory, feature and storage model of the non relational database, and expounds its advantages compared with the relational database. Then, from the function and performance of the micro-blogging system specific storage requirements for in-depth analysis, the use of three different storage models in the database, including Redis, HBase and MongoDB, combined with their characteristics to study the implementation of micro-blog system-related storage functions, A data storage scheme suitable for micro-blogging system is proposed, and the data storage structure is designed, which can meet the requirement of real-time, expansibility, reliability and concurrency. At the same time, the author uses the relational database to design, and through the comparison, proves the rationality of the research of the non relational database theoretically. Finally, according to the design of the micro-BO system storage structure, select the typical test scenarios, using different database platform, carried out a series of verification tests. Through the analysis and comparison of the test results, it can be proved that the data storage scheme designed by this paper is effective, which can meet the storage requirement of the micro-blogging system, and provide solutions for the data storage problem with similar requirements in heterogeneous large data environment.

Research on heterogeneous large data storage method