Design and implementation of network identity recognition system based on hadoop/hive architecture

Design and implementation of network identity recognition system based on hadoop/hive architecture

Nanjing University of Posts and telecommunications Shingwen

Based on the actual system development, this paper summarizes the design and implementation of a network identification system based on hadoop/hive architecture. After the raw data of each data source is cleaned layer by mapreduce, it is loaded into a new event-based data warehouse. Then, using the HIVEQL language, under the control of the Professional Workflow Control tool, the data analysis and processing work are completed according to the user's requirements. Finally, the data analysis results are presented to the user. The function of the system has been put into use in part, and the performance index has reached the user's requirement and has high practical value.

Design and implementation of network identity recognition system based on hadoop/hive architecture