Online Trends

Design and realization of hospital data center system based on Hadoop Zhejiang University Zhang Honglei This thesis first completes the development of the Hospital data Center system, then takes the electronic medical record system as an example, realizes the high-speed reading and storage of the structured data in the data center; Taking PACs as an example, It realizes the high speed storage and reading of the unstructured data in the data center, and implements the recommendation engine algorithm on the machine learning platform. The data center system of the hospital based on the Hadoop distributed framework has the advantages of low implementation cost, safe and reliable data storage, easy expansion of the system and speed of data reading and writing.

Design and implementation of cloud security storage system based on Hadoop Guangdong University of Technology Shangxiangyang Cloud computing is the development of distributed computing, parallel computing and grid computing, which brings about a fundamental change in human life, production mode and business model, and is one of the focuses of the whole society. Cloud storage is a new concept that extends from the concept of cloud computing, it refers to the use of cluster applications, grid technology or Distributed file system functions, the network of a large number of different types of storage devices through the application of software together to work together to provide data storage and business visits ...

Research and implementation of cloud computing and storage platform based on Hadoop Dong Shiqing liyunlong Tian Tangming Hu Hailong The high cost of traditional data calculation and storage, the difficulty of parallel programming, in view of this problem, based on the summarization of Hadoop core technology, using Hadoop distributed processing technology and virtualization technology design, The platform of cloud data computing and storage cluster is set up, and the experiment shows that this platform has higher performance than traditional single machine calculation method and physical machine cluster calculation method, and the resource utilization rate is also improved. Research on cloud computing and storage platform based on Hadoop and ...

Intelligent Home Information processing platform based on Hadoop Xu Yuan Guo Wang Intelligent Home includes access control system, temperature and humidity system, indoor drip irrigation system, lighting system. Each system contains different terminals, each with a different sensor, and the sensor perceives a large amount of data in the surrounding environment. The increasing number of users will result in massive data. This paper aims at the problems of high hardware cost and computational bottleneck in the traditional mass data processing method, based on the theory of cloud computing, the access control system, the temperature and humidity system, the drip irrigation system and the illumination system of intelligent home are built on the basis of Hado ...

Research on parallelization of TFIDF algorithm based on Hadoop platform Wang Jingyu Zhao Weiyan Computer Engineering and Science 2014-year 06 phase research on the parallelization of TFIDF algorithm based on Hadoop platform

Research and implementation of distributed ETL based on Hadoop Platform Donghua University gang the author mainly studies and realizes the work as follows first, distributed ETL Framework design. Based on the theory of dimension modeling in Data Warehouse, a distributed ETL framework including dimension and fact parallel processing and HDFS data block allocation is designed by analyzing the MapReduce working mechanism and job scheduling under the Hadoop platform. Second, the study of the parallel processing of facts. From the fact table lookup Surrogate key and the multi-granularity fact pre-aggregation two angles to start, put forward in the gradient ...

Research and implementation of visual data clustering based on Hadoop platform University Lin Hadoop is a distributed model for solving large data storage and analysis problems. Clustering algorithm can make the feature expression of visual data through clustering generation code book. How to complete the clustering algorithm in the distributed model is an important problem in the research and production. Aiming at the problem of large-scale visual data clustering, this paper designs and realizes the visual data clustering algorithm based on Hadoop model, which improves the efficiency of visual data clustering. This paper first introduces the visual characteristics, analysis ...

Research on random forest algorithm based on Hadoop platform and realization of image classification System Xiamen University Liang This paper combines Hadoop open source distributed computing platform, This paper studies the parallelization of image processing and the distributed parallel design of stochastic forest algorithm using MapReduce parallel computing model to improve the efficiency of large-scale image classification. First of all, this paper introduces the Hadoop platform, including HDFs file system and MapReduce framework, then analyzes the key techniques of image classification, and summarizes some features commonly used in image classification,...

The design of news cloud scheme based on Hadoop platform Shang Shiya Social progress can not be separated from the news, the dissemination and sharing of news is an important way to improve human quality? To improve the service level of news, adopt the advanced concept and advanced technology of cloud computing, design a news cloud prototype platform, provide service for news industry? This platform introduces Hadoop as the storage core of news data, uses hive database to solve Data transformation and lookup, and can complete the retrieval of massive data. The design of the program has been part of the test to achieve the design requirements? Based on the Hadoop platform ...

Research on the construction of medical and health data center based on HBase and the synchronization of heterogeneous database Fang Shiwei to determine the data model, this paper puts forward the idea of HBase C-o-r modeling based on the E-R modeling of relational database, Then comprehensive analysis of Health department promulgated medical and Health metadata standards and the actual situation of some health institutions to achieve health information HBase Data Center construction. In order to realize the synchronization of data transparently to data center in heterogeneous relational database of medical institutions, the following schemes are proposed. First of all, in the data format proposed heterogeneous database production ...

Research and implementation of distributed storage based on HDFS Weishukang This paper analyzes the structure and operation mechanism of HDFS, points out some design defects, and improves the HDFS's copy strategy, the main work is as follows: (1) HDFS The default static replica redundancy policy does not distinguish hot data. The node that holds the data is a bottleneck in the cluster. To solve this problem, a dynamic redundancy strategy based on data heat is proposed in this paper. This strategy counts and predicts access to each file, and the statistical cycle of each file is visited ...

Multidimensional Cloud Data Index He Yi Yue Yangfan based on KD tree and R-Tree Yun Chunrezhouvi for the cloud storage system, most of the data are stored on the Key,value model based on the key value, the multidimensional query needs to completely scan the whole dataset, the query efficiency is low, and a multidimensional index structure based on KD tree and R tree ( Abbreviation KD-R index). The KD-R index adopts the double index model, establishes the multidimensional global index based on KD tree on the global server, and constructs the R-Tree multidimensional local index in the local data node. Based on the performance loss model, select the R tree with lower index cost ...

A method of clustering detection of malicious code model based on K-L divergence Bengenqing Liang Shao Bilin in cloud Computing application environment, because the service system is more and more complex, the network security loophole and the attack situation increase dramatically, the traditional malicious code detection technology and the protection pattern already cannot adapt the cloud storage environment the demand. Therefore, by introducing the Gaussian mixture model, establishing the layered detection mechanism of malicious code, analyzing and extracting the characteristic value of sample data by means of information gain and document frequency, and combining the K-L divergence characteristic, a malicious code model clustering detection method based on K-L divergence is proposed. Adopt KDDCU ...

Design and implementation of private cloud platform for e-government based on Liferay Shandong Normal University Wang Shihu this thesis constructs the private cloud platform based on the Hadoop framework, uses the Java EE as the development platform, the MySQL serves as the backstage database, takes the Liferay portal as the foundation to construct the E-government website, Design and implementation of the Government Bulletin, mail system, cloud network disk, workflow, collaborative office functions. The paper first discusses the development background and research status of e-government, according to the specific affairs and operation process of the government affairs, to E-Government department ...

Research on distributed polar Graph construction algorithm based on MapReduce Beijing Jiaotong University Nannan with the rapid development of cloud computing technology, many research and applications related to large-scale data processing have been migrated to cloud computing environment, such as data mining, network search, image processing and bioinformatics analysis. The large scale data processing technology is also the research hotspot in the field of high performance computing. In the graph theory research, the polar graph constructs the algorithm as the Polar graph theory important research content, receives the people's attention more and more. The polar graph is the graph which satisfies certain stipulation condition and the number of edges, its construction ...

Design of parallel algorithm for spatial sensitivity analysis based on MapReduce Li Fan He Honglin Jinghinli Zhang Lu Ying in the recent years, with the remote sensing spatial data widely used in the ecosystem, the development of the regional scale ecological Remote sensing parameter model has been promoted. Sensitivity analysis plays an important role in identifying key parameters of model, reducing model uncertainty and perfecting model. In the sensitivity analysis of the model parameters, the stand-alone environment can not meet the requirement of fast analysis because of the complex operation of spatial data. In order to improve the ecological remote sensing parameter model space ...

An ant colony optimization algorithm based on MapReduce Wang Zhao far Li Tianrui Ishiwen discusses several parallel ways and scenarios of ant colony algorithm and the feasibility of combining the cloud computing programming framework MapReduce, and abstracts the local search class ant colony optimization algorithm into several components, corresponding to several interfaces of the MapReduce framework, it provides a flexible and scalable solution for this ant colony optimization algorithm to achieve parallelization under MapReduce framework. Finally, the validity of the proposed method is verified by the simulation experiment of the traveling quotient problem. ...

Mass data processing technology of intermittent energy based on mapreduce model Mei-hua-mai enhanced Wu Guanglei in view of the limitation of traditional intermittent energy data processing technology, a batch energy data processing technology based on MapReduce model is proposed, which makes use of Low-cost commercial computer to form a cluster. The parallel processing of massive data ensures the reliability, low cost, high efficiency and scalability of the mass processing, and discusses the platform implementation of the technology. At last, the efficiency of mass data processing under different data platform is compared and validated based on Mapre ...

The research of sorting algorithm optimization based on mapreduce model Jin Yu MapReduce has developed into a parallel computing model of large data domain standard. Ideally, a mapreduce system should allow all nodes involved in the calculation to be highly balanced and minimize space usage, CPU and I/O usage, and network transport overhead. Traditional algorithms are usually only optimized for one of the above metrics. Based on the good parallelism of the algorithm, the design criterion of mapreduce optimization algorithm is put forward. ...

Query processing of large-scale vector spatial data selection based on Mapredue Tao Daiju Zheng Zezhong Liu Shuai for the efficient processing of large-scale vector space data, based on Hadoop parallel computing Framework mapredue, a distributed vector spatial data selection query processing method is realized. First of all, This paper analyzes the Key/value data model of OGC simple factor Standard and Hadoop, designs the vector file format which can be stored in Hadoop HDFs, secondly, according to the two-stage filtering-refining strategy, the map input data fragment, choose to search ...