Overview of large data systems and analysis techniques

Overview of large data systems and analysis techniques

Cheng Wang Win Guojie

First, depending on the form of treatment, this paper introduces the characteristics of different forms of data and their typical application scenarios as well as the corresponding representative processing system, and sums up the three development trends of large data processing systems. Then, the system supported by the large-scale analysis technology and applications (including depth learning, knowledge computing, social computing and visualization, etc.) A brief review is made, and the key roles of various techniques in the process of large data analysis and understanding are summarized. Finally, the paper analyzes the data complexity, computational complexity and system complexity challenges faced by large processing and analysis, and puts forward some possible countermeasures.

Overview of large data systems and analysis techniques