String Blocks

This paper is an excerpt from the book "The Authoritative Guide to Hadoop", published by Tsinghua University Press, which is the author of Tom White, the School of Data Science and engineering, East China Normal University. This book begins with the origins of Hadoop, and integrates theory and practice to introduce Hadoop as an ideal tool for high-performance processing of massive datasets. The book consists of 16 chapters, 3 appendices, covering topics including: Haddoop;mapreduce;hadoop Distributed file system; Hadoop I/O, MapReduce application Open ...

You can implement your own blockchain with less than 200 lines of Go code! Sounds interesting? What better way to learn than to develop a blockchain of your own? Then let's practice together!

Editor's note: The last period of time reproduced in the "5 minutes to understand docker! "Very popular, a short 1500 words, let everyone quickly understand the Docker." Today, I saw the author make a new novel, and immediately turned over. The reason to call this code reading as a fantasy trip is because the author Liu Mengxin (@oilbeater) in the process of reading Docker source, found a few interesting things: from the code point of view Docker did not start a new development mechanism, but the existing tested isolation security mechanism to use the full use, Including Cgroups,c ...

Blockchain is a new technology that is gradually emerging with the increasing popularity of digital cryptocurrencies such as Bitcoin.

MapReduce: Simple data processing on large cluster

Objective This tutorial provides a comprehensive overview of all aspects of the Hadoop map-reduce framework from a user perspective. Prerequisites First make sure that Hadoop is installed, configured, and running correctly. See more information: Hadoop QuickStart for first-time users. Hadoop clusters are built on large-scale distributed clusters. Overview Hadoop Map-reduce is a simple software framework, based on which applications are written to run on large clusters of thousands of commercial machines, and with a reliable fault tolerance ...

Objective This tutorial provides a comprehensive overview of all aspects of the Hadoop map/reduce framework from a user perspective. Prerequisites First make sure that Hadoop is installed, configured, and running correctly. See more information: Hadoop QuickStart for first-time users. Hadoop clusters are built on large-scale distributed clusters. Overview Hadoop Map/reduce is a simple software framework, based on which applications can be run on a large cluster of thousands of commercial machines, and with a reliable fault-tolerant ...

1 compression in general, the computer processing of data exist some redundancy, at the same time, the data, especially the correlation between adjacent data, so you can through some different from the original encoding of the special encoding method to save data, so that the data occupy a small amount of storage space, this process is generally called compression. The concept of compression corresponds to decompression, the process of restoring compressed data from a special encoding to the original data. Compression is widely used in mass data processing, compression of data files, can effectively reduce the space required to store files, and speed up data on the network or to ...

When a dataset is large in size beyond the storage capacity of a single physical machine, we can consider using a cluster. File systems that manage storage across networked machines are called Distributed File Systems (distributed http://www.aliyun.com/zixun/aggregation/19352.html ">filesystem"). With the introduction of multiple nodes, the corresponding problem arises, for example, one of the most important question is how to ensure that when a node fails, the data will not ...

The blockchain is a big hit at the moment, and the news media has reported a lot, claiming that it will create the future.