Distributed Computing

It is said that there is no point in improving supercomputers at a rapid pace in distributed computing, such as HTC's power to give program, which allows your phone to gain the same computational capability as a supercomputer. Even so, the attempt to miniaturization the supercomputer is valuable, and in many scenarios we cannot guarantee that the device is connected to the cloud. Yesterday Nvidia CEO Huang unveiled a miniature version of the supercomputer Jetson TK1 at the company's GPU technology conference, Engadget reported. This board and Arduin ...

Measurement of Urban road travel time based on MapReduce Shuai Zhaozhou Dinwilong Wang Xiaohui Urban Road travel time calculation has been one of the core problems in intelligent transportation system, and accurate and efficient travel time calculation can effectively help road control and reduce traffic congestion. However, in the face of huge and fast-growing urban road traffic detection data, how to integrate the distributed computing model into the traditional travel time calculation problem has become an urgent problem to be solved. Based on the massive road license plate recognition data, the paper designs a city based on MapReduce programming model.

Grid computing can organize a large number of decentralized computers into a "virtual http://www.aliyun.com/zixun/aggregation/13840.html" > supercomputer, which should be one of the major technical tools for large data and high performance computing challenges. This article mainly introduces the method of writing grid applications on the IBM Platform Symphony platform in the Java language. Background The grid computing is distributed computing (Distribut ...).

Research and demonstration of distributed electricity calculation system based on cloud computing Sukey in order to deal with the huge challenge of the electricity calculation system, this paper uses the distributed computing technology in cloud computing, based on a trust-driven task scheduling algorithm Tr-max-min, proposes a new system structure of the Distributed electricity Tariff computing platform, The system is implemented in the IT environment of the power grid. By simulating the calculation task of electricity bill, the efficiency of the system for the comprehensive processing of massive data is validated. As an effective task-solving method for large amount of power network operation, it provides a ...

Remote Python Call (RPYC) is for RPC remote procedure calls and http://www.aliyun.com/zixun/aggregation/13452.html "> A simple and symmetric Python Library of distributed computing. It supports synchronous and asynchronous operations, callbacks, secure remote services, and transparent object proxies. Remote Python Call 3.2.2 is a maintenance version, fixed on Windows ...

Cloudreports is a graphic tool this simulates distributed computing environments based on the Cloud computing. It uses Cloudsim as its simulation engine and provides a easy-to-use user in ...

Globus Toolkit is a toolkit derived from the Globus project, providing stability on http://www.aliyun.com/zixun/aggregation/13840.html "> supercomputer, Distributed computing, clustering, and other high-performance system functions for secure and peer-to-peer networks. It differs from other network toolkits, but is tuned to the needs of high-end machines. Globus is an open architecture, open standard project for building computational grids. is an open source ...

Cable-Bell filter technology based on parallel programming computation Xu Changlong Wang Smart Shuo Hua with the increase of the data volume of remote sensing image, the computation time of the edge filtering operation in a single environment is also greatly increased. According to the characteristics of remote sensing data, combined with MapReduce parallel distributed computing model, this paper proposes a method of migrating this operation into Hadoop cluster environment to complete the Bayes filtering operation of massive image data. The experimental results show that the cluster operation can shorten the computation time, and the calculation time will decrease with the increase of cluster node number. ...

Highly scalable sparse matrix multiplication Wuzhiguang Mao Chen Han Lei lijun matrix multiplication is a very important basic operation in linear algebra and graph algorithm, while the matrices in large-scale data processing are often sparse matrices. The MapReduce programming framework can effectively support the distributed computing of massive data. Therefore, how to use MapReduce programming framework to realize the multiplication of super large sparse matrix is studied. The traditional matrix multiplication parallel algorithm does not specifically optimize the sparse matrix, resulting in a large number of unnecessary communication overhead during the calculation.

Recently, there have been people or asked about the difference between cloud computing and grid computing, or that cloud computing is an extension of grid computing, and even scholars write comparative papers. 　　In fact, cloud computing has nothing to do with grid computing, but this article will clarify the difference between cloud computing and grid computing, as well as the concepts of cloud computing and distributed computing, utility computing, and so on. Narrow cloud computing refers to the delivery and usage patterns of IT infrastructure, which means acquiring the required resources (hardware, platform, software) on an as-needed and extensible basis over the network. A network that provides resources is called a "cloud." Resources in the cloud ...

Mining of massive frequent itemsets based on pfp-growth algorithm Jiangyuan, Li Ping with the development of Internet technology, network data becomes more and more huge, how to excavate effective information has become the focus of people's research. In recent years, frequent itemsets mining has been paid more and more attention because of its important role in the task of Mining Association rules and related mining. In this paper, the algorithm of frequent itemsets mining in distributed computing environment is studied, the PFP-GROWTH algorithm is improved, and the improved pfp-growth algorithm is carried out by MapReduce programming model.

Cloud computing is a very popular concept nowadays. What kind of thing is it? The following Gartner definitions have become classic and are heavily referenced: Cloud computing is "a style of computing where massively scalable it-related capabilities are Provided ' as a service ' across ...

Adapt:availability-aware MapReduce Data slide-up for non-dedicated distributed Computing Jin, Xi Yang, Hui Sun, Ioan Raicu in this, we propose a availability-aware DAta placemen ...

Design and construction of distributed JS Parsing system The tong of Beijing Jiaotong University mainly includes two research directions: firstly, it is effective to extract and parse JavaScript in Web page, and then combine with Hadoop distributed computing technology to analyze the existing task scheduling algorithm and Based on the actual situation of this system, the task scheduling algorithm in distributed computing environment is designed, and the JavaScript parsing task scheduling is reasonable, which realizes the efficient parsing of the JavaScript fragment contained in the page. Through the Javas ...

Cloud computing is "a" a style of computing where massively scalable it-related capabilities are ' as a service ' provided the Internet to listbox external customers using Internet t ...

Absrtact: It is said that there is no point in improving the supercomputer at a rapid pace in distributed computing, such as the HTC Power to give program, which allows your phone to gain the equivalent of a supercomputer. Even so, the attempt to miniaturized supercomputers is also said to be meaningless at a moment of rapid development in distributed computing, such as HTC's power to give program, which allows your phone to get the equivalent of a supercomputer. Even so, ...

Absrtact: It is said that there is no point in improving the supercomputer at a rapid pace in distributed computing, such as the HTC Power to give program, which allows your phone to gain the equivalent of a supercomputer. Even so, the attempt to miniaturized supercomputers is also said to be meaningless at a moment of rapid development in distributed computing, such as HTC's power to give program, which allows your phone to get the equivalent of a supercomputer. Even so, ...

Research on random forest algorithm based on Hadoop platform and realization of image classification System Xiamen University Liang This paper combines Hadoop open source distributed computing platform, This paper studies the parallelization of image processing and the distributed parallel design of stochastic forest algorithm using MapReduce parallel computing model to improve the efficiency of large-scale image classification. First of all, this paper introduces the Hadoop platform, including HDFs file system and MapReduce framework, then analyzes the key techniques of image classification, and summarizes some features commonly used in image classification,...

Research on the cloud computing framework based on spark detection Hu Haiho plagiarism detection is fundamentally a computational problem of text similarity, which requires rapid and accurate detection of textual originality in mass anthology, which consumes a lot of time and resources, and is a complex process of computation-intensive and data-intensive. Using distributed computing is one of the effective methods to improve the detection efficiency. This paper presents a set of distributed plagiarism detection cloud computing framework based on spark this framework uses the MapReduce computing framework that supports the memory presence by using the cluster Explorer Apache Mesos ...

Absrtact: It is said that there is no point in improving the supercomputer at a rapid pace in distributed computing, such as the HTC Power to give program, which allows your phone to gain the equivalent of a supercomputer. Even so, the attempt to miniaturized supercomputers is also said to be meaningless at a moment of rapid development in distributed computing, such as HTC's power to give program, which allows your phone to get the equivalent of a supercomputer. Even so, the attempt to miniaturized supercomputers is valuable ...