Online Trends

Research on real-time control of remote equipment in environmental protection network Dinghao Tagyojin Bing Cheng Select Flash Xmlsocket as the key technology of two-way communication between browser and server, which solves the problem that the HTTP protocol can not realize real-time bidirectional communication directly; By establishing the socket Connection Channel routing table on the listener server side and updating it in real time, it solves the problem that the server can only passively connect the number-mining instrument to the real-time control delay. The results show that the server-side control delay is very small, almost negligible, browser-side in sufficient network bandwidth, also ...

Design and implementation of intelligent traffic cloud computing platform based on cloud foundry The starting point of this thesis is to design and implement the intelligent traffic cloud computing platform by merging the existing cloud computing technology and aiming at the common problems in the construction of the traffic system in the transportation field. The main contents of this paper are as follows: 1. Background management platform design and implementation: The design of the cloud platform in the background management of the "master-from" style structure, through the central Control node distribution commands, cloud Platform node client execution mode. The implementation of the use of Cfdo tool ...

Research on distributed data stream clustering algorithm based on Hadoop mapreduce Cai Binlei Ningjiadong Zhu Shiwei Guo Qin with the continuous increase of data flow scale, the existing clustering algorithm based on grid has no effect on the clustering of data streams, can not find any shape clusters in real time, and can not delete the noise points in the data stream in time. This paper presents a distributed data stream clustering algorithm (Pgdc-stream) based on grid density in Hadoop platform environment, which facilitates the parallel clustering of data flow in MapReduce framework based on Hadoop.

Realization and optimization of k-medoids clustering algorithm based on Hadoop East China Normal University Shang based on the features of K-medoids algorithm and the advantages of Hadoop platform, the implementation of parallel K clustering algorithm implemented in Mahout open source project is referenced. In this paper, a parallel clustering algorithm based on MapReduce is proposed, which hk-medoids the operation rate of the traditional clustering algorithm greatly. In addition, in order to further improve the clustering efficiency, this article from the perfect mapreduce scheduling, take sampling method, pre ...

Design and realization of multi-star table storage and cross-identification based on Hadoop the Zhang Xiaxu of Shandong University is particularly important in the face of astronomical data, how to efficiently store and cross-identification of multiple-star table. Massive astronomical data processing must use the large data processing technology such as distributed, parallel computation to be able to solve effectively. In this paper, the use of Hadoop to deal with astronomical data is studied, the main work is divided into the following three parts: 1. Using the HBase component of Hadoop, the effective storage of different star table data is constructed, and the efficiency of cluster disk utilization and the query of Star table information is improved. ...

Research on the method of storing large amount of small files based on Hadoop Qian Fang Yuai Liang Peng with the development of science and technology, various industries and fields need to deal with the data is explosive growth. Hadoop is an ideal platform for large file storage processing, but Hadoop does not perform satisfactorily when dealing with massive amounts of small files.  Firstly, this paper introduces the system architecture of HDFS, then analyzes the problems existing in the HDFS processing of large amount of small files, and finally introduces the optimization scheme of this problem at home and abroad. A mass of small text based on Hadoop ...

Design and implementation of a large amount of small XML data file processing technology based on Hadoop University Kong Xin This paper focuses on the following: 1 a distributed mass of small XML data processing system (distributed Massive smallxml files SYSTEM,DMSX), the main idea of the system is to use a large number of small data XML files in the Hadoop system for efficient processing. 2 The system through the use of producer-elimination ...

Design and realization of video monitoring system based on Hadoop Inner Mongolia University Liang with the Peace China Project in-depth, the public's demand for video surveillance is more and more intense. Camera and other video acquisition equipment, the clarity of the continuous increase in the number of monitors, video processing needs to improve, this and the traditional network video surveillance system architecture conflict. The rising cloud computing has opened up a new road for video surveillance, the cloud video monitoring system satisfies the requirement of large data calculation and storage, and solves the defects of traditional video surveillance system. This article is the work of the cloud computing technology ...

Research and implementation of scheduling algorithm based on Hadoop Southwest Jiaotong University Li Yu This paper presents an improved method of estimating execution time. In the map phase, the mean value method is used as the estimating method according to the historical execution information. The reduce phase uses a combination of sampling and feedback estimation methods. This algorithm can estimate the execution time of the task more accurately and provide the effective time estimation method for dynamically allocating resources. Given that Hadoop's built-in scheduling algorithm does not meet the need to effectively differentiate between CPU-intensive and I/O-intensive types of jobs and jobs that require completion at a specific time ...

Research on the homology search go function annotation platform based on Hadoop Nanjing Wu Haoyu The main research work of this paper is as follows: (1) The theoretical basis of gene ontology and the application of Go ontology in bioinformatics, especially the annotation of gene function, are studied. This paper analyzes the existing annotation methods of genetic data and the theoretical basis of functional annotation based on homology sequence similarity. (2) The process of gene function annotation based on sequence similarity ratio is studied. In the process of discovering homology sequence, the scoring matrix and sequence alignment algorithm are studied.

What is the "scale" of the specified virtual machine? We can specify the size of the virtual machine on which the role will be deployed. The "scale" of the virtual machine means: 1,cpu Core 2, Memory capacity 3, local filesystem volume we can specify the "scale" of the virtual machine for specific roles. There are two ways to specify the size of a virtual machine: 1, which specifies the size of the virtual machine through the service definition file. 2, if you use Visual Studio, you can specify the size of the virtual machine by using the Properties tab of the role. ...

Construction and development of large data service and application of China Unicom data Center December 2013--the ability to translate large data into commercial value has been amply demonstrated by the Internet industry, operators control real user data, communication characteristics, consumer behavior, traffic access, terminal type, location and other information, more accurate, more comprehensive, More convenient and more commercial value-Operator large data includes 5 types of data sources, and each has its own characteristics, in the data concentration process, in accordance with the actual needs of the use of different methods of collection, conversion, integration, association and processing, relying on large ...

Information-Type News-Jiangholiang system The left spring takes into account that the picture has a strong interpretation of events, the characteristics of the dissemination of convenience, research from a large number of data-intensive news Web pages automatically extracted data, and organize a complete set diagram structure to show the user. Dynamic page extraction and parsing are realized based on page template, and processing is converted to the corresponding data structure. Based on cosine correlation, the data from different websites are weighed and sorted according to the corresponding standards. Considering the huge news data and the number of users, this system is based on Hadoop distributed platform to meet the ...

A large-scale derived sub-graph extraction algorithm for adaptive cloud Guo Xin Dongjian Zhouqingzhuang Ping for the existing cloud computing platform resource allocation and the traditional derivation of the sub-graph mining efficiency is lower, and further enhance the cloud computing platform resource integration utilization efficiency and large-scale export of child graph mining efficiency, In this paper, an adaptive cloud extraction algorithm is proposed to solve the problem of resource optimization and mass map mining. Firstly, it introduces the concept of cloud computing and the related concepts of the derivation of the sub graph and the problem description. Then, according to the MapReduce parallel processing model ...

On the EC2, I used the Rightscale ami as the V1 version of Centos5, which has a kernel version of 2.6.16. You can use the following methods to upgrade to 2.6.18. Because Amazon allows you to select the kernel version at startup, Amazon offers the latest kernel version of 2.6.18 (in fact, Rightscale is using Amazon's 2.6.18 kernel), so you can choose to use 2.6.18 kernel startup and then in ...

1. List the machines used in general PC, requirements: Cpu:750m-1gmem: >128mdisk: >10g does not need too expensive machines. Machine Name: FINEWINE01FINEWINE02FINEWINE03 will finewine01 as the main node, and the other machine is from node. 2. Download and build from here Checkout, I choose Trunkhttp://svn.apache.org/repos/asf/lucen ...

10gen is a cloud computing platform that can provide scalable, high-performance data storage solutions for Web applications. 10gen Open Source project is MongoDB, the main function is to solve the website of operational data storage, session object storage, data caching, efficient real-time count (such as statistical pv,uv), and support ruby,python,java,c++, PHP and many other page languages. MongoDB main feature is the storage of data is very convenient, not the traditional object-rel ...

2005 Shanghai, with its dominant position in China's foreign trade, replaced Rotterdam as the largest port in the world, becoming an important milestone in China's economic development. In the world's largest port bustling behind, people may not notice in the ocean as broad as the Internet, another belongs to China's "the world's largest port" has begun to take shape: 2005, Thunderbolt-this familiar resource download engine, Already with the outstanding download speed and rich resources to become the world's largest, download the largest download engine. Today, "Thunder Port" every ...

April 12, according to foreign media reports, Microsoft in Monday, held in Atlanta Convergence Conference announced that Microsoft will dynamics ERP (Enterprise resource planning) applications to the Azure cloud platform. This late move is a major shift in Microsoft's sales of Dynamics apps. Microsoft used to sell dynamics through partners in a way that was internally deployed and hosted. Microsoft said in a statement that the next important release of Dynamics software would run on the Azure platform. User ...

June 24 News, according to foreign media reports, the world's leading IT market survey and research firm Gartner Research company recently announced that the global Cloud computing Services Market 2010-year total revenue will reach 460 pounds, the data is up 16.6% from 2009. North American market revenue will account for 60% of total global revenue, and European market revenues will account for 23.8%. Nick Pring, vice president of Gartner Research, Nick Plin that with the popularity of cloud computing services that can support thousands of of simultaneous servers, ...