Design and implementation of Water conservancy Census data mining system based on Hadoop cloud Platform

Design and implementation of Water conservancy Census data mining system based on Hadoop cloud Platform

Fanlong Wandingshen Gu Xinzhen

Aiming at the characteristics of large amount of water conservancy census data and many attributes, this paper presents a data mining system of Water Conservancy survey based on Hadoop Cloud Platform, introduces the design idea and structure of the system, and expounds the function of each module in detail. The system utilizes the Hadoop cloud platform to implement an improved parallel association rule algorithm, which takes full advantage of the ability of the Hadoop platform to process data in parallel and reduces the cost of development. It is proved that the system has better usability and higher mining efficiency through single machine contrast test and cluster test.

Design and implementation of Water conservancy Census data mining system based on Hadoop cloud Platform