Study on cloud computing model based on Hadoop and meteorological application

Study on cloud computing model based on Hadoop and meteorological application

Nanjing University of Information Engineering Zhangjian

The main work of this paper is as follows: firstly, the characteristics of meteorological data are analyzed, and the problems of storing meteorological data directly in Hadoop are pointed out. According to the characteristics of meteorological data, a file merging algorithm based on Trie tree deformation is designed. On this basis, the experimental verification, data efficient processing, security and other aspects of effective promotion and protection. Secondly, the design and implementation of a large number of meteorological heterogeneous data storage and computing framework based on Hadoop, in view of the real-time data extraction efficiency, data security, disaster backup and other problems, using HDFS to store meteorological data and the use of MapReduce to build parallel algorithms, The storage and processing framework of massive meteorological heterogeneous data based on Hadoop is proposed. and through the actual business operation, will verify in the Concurrency data processing effect, achieves can reduce the cost effectively and guarantees the data security the goal. This paper combines the research model with the practical business application, utilizes the frontier distributed technology to meet the needs of the project well, and deploys the model to the example, and verifies the practical value of the model with the actual running result. These work have important theoretical value and practical value for the research of large data processing.

Study on cloud computing model based on Hadoop and meteorological application