What is HDFS Hard Disk Public Chain?

Source: Internet
Author: User
Keywords hard disk blockchain hdfs commands hard disk

What is HDFS hard disk public chain? ?

Hadoop Distributed File System (HDFS) refers to a distributed file system (Distributed File System) designed to run on commodity hardware. It has a lot in common with existing distributed file systems. But at the same time, the difference between it and other distributed file systems is also very obvious. HDFS is a highly fault-tolerant system, suitable for deployment on inexpensive machines.
Simple Application Server
USD1.00 New User Coupon
* Only 3,000 coupons available.
* Each new user can only get one coupon(except users from distributors).
* The coupon is valid for 30 days from the date of receipt.

HDFS is also one of many distributed storage projects, but the difference is that HDFS is a highly completed project. When it was discovered by miners, it was very close to the mainnet line to start mining.

As a distributed storage project, what he wants to solve is mainly the problem of user personal data storage safety, privacy, and efficiency, and use distributed storage technology to meet the needs of the C-side. Compared with the Fecoin project, HDFS is actually more grounded.

Cheap hard disk storage computers and related equipment can be added as nodes

HDFS can provide high-throughput data access and is very suitable for applications on large-scale data sets. So you only need to join the node as a contribution to get the reward mechanism. HDFS uses the POC+POST mortgage mining mechanism. Users provide hard disk storage space to save data for the main network in exchange for HDFS rewards. Due to the particularity of hard disk mining, in order to allow miners to continue to save data, HDFS adopts the principle of mortgage mining, and the weekly mining income is delayed by one week to encourage miners to store data.

Data fault tolerance and recovery mechanism

Meet greater than N+3 to ensure data integrity

HDFS is designed to reliably store a large number of files among a large number of machines in a cluster. It stores files in the form of block sequences. Except for the last block in the file, all other blocks have the same size. The blocks belonging to the file are copied for fault tolerance. When there are more than 3 nodes, even if the node is damaged or shut down, it will not affect the loss and safety of the file, unlike IPFS when the node is shut down, the file does not exist!

What are the highlights of HDFS?

Communication protocol, safe and secret

All nodes are active peer-to-peer P2P, integrating blockchain features and mechanisms.

P2P is a distributed network. Participants of the network share part of their own hardware resources (processing power, storage capacity, network connection capacity, printers, etc.). These shared resources need to be provided by the network for services and content, which can be used by other parties. Wait for peers to access directly without going through intermediate entities. Participants in this network are both resource (service and content) providers ( server) and resource (service and content) acquirers (client). RPC (Remote Procedure Call) abstractly encapsulates Client Protocol and DataNode Protocol. According to the design, the name node will not actively initiate an RPC, it just passively responds to the RPC initiated by the data node and the client.

Data correctness

A file block taken from a data node may be a bad block. The occurrence of a bad block may be a storage device error, a network error or a software vulnerability. The HDFS client implements the verification of HDFS file content. When a client creates an HDFS file, it calculates a check code for each file block and stores the check code in a separate hidden file under the same HDFS namespace. When the client accesses this file, it verifies the data received from the data node according to the corresponding check file. If the verification fails, the client can choose to obtain the block from other data nodes that have a copy of the block.

How complete is HDFS

As a project that is about to go online, HDFS is obviously not as popular as Fecoin. Many miners have questions. Why can you believe that HDFS can do things that Fecoin can't do? In fact, HDFS is a highly completed project. The difference is that HDFS insists on not open beta, no pre-excavation, so there is no vigorous open beta competition, but its true value content may exceed many people's imagination. HDFS is currently close to being online, and The user-side APP is also nearing completion, which is rare in the industry.

HDFS can not only store the trading records of encrypted currencies, but also store other types of data, solve the current data storage problems, and realize the efficient sharing and application of data and resources. It can be used in many industries.

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.