Blockchain Maturity evaluation Report (3)-reliability, ease-of-use, scalability comparison __ Blockchain

Reliability Comparison

The reliability of blockchain mainly investigates three aspects of blockchain network, shared ledger and account system.

(a) Blockchain network: Commercial blockchain A, commercial blockchain B, fabric are network reliable

The blockchain network mainly tests three indicators: high availability of accounting nodes, high availability between service nodes, and network jitter of blockchain networks, whether the system service level is affected. The test method of the first to second indicator is through the script to evaluate, set up the blockchain contains N accounting nodes or service nodes, through the script to stop the 1~n accounting node or service node, check whether the blockchain network is still able to properly execute transactions, reach a consensus and accounting or service node external services The third indicator test method is a tool for simulation evaluation, in the specified service level and network size, by simulating a certain amount of network nodes to join or exit, to obtain its tolerated proportional value. The specific test results are shown in the following table.

The test results show that the commercial blockchain a, commercial blockchain B, and fabric all support the high availability of accounting nodes and service nodes, and the network jitter does not affect the system service level, and three blockchain systems are network reliable.

(ii) share the book: commercial blockchain A, commercial blockchain B, fabric are ledger reliable

Shared account This main test three indicators: Ledger high availability, ledger support failover synchronization, ledger backup recovery. The evaluation method of the first to second indicator is the evaluation by the script, the third indicator evaluation method is based on the white Paper and related documents expert judgment, specifically, the first indicator test method is to assume that the blockchain contains N accounting nodes, each billing node has a shared ledger, through the script to stop 1~ N Accounting nodes, check whether the blockchain network is still able to properly execute transactions, reach consensus and account, restore the stopped nodes, check whether automatically synchronized to the latest ledger; the second indicator is to stop one of the accounting nodes in the blockchain network through a script. After 10 blocks of the generation time through the script to re-open the node, restore the Stopped node, check whether automatically synchronized to the latest ledger and resume the bookkeeping ability; The third indicator test method is to determine whether there are backup and recovery tools, if any, using the tool for backup and export operations, after a period of time, Use the tool to perform a backup recovery import operation, check that the ledger is back to the state of the backup, and run normally. The specific test results are shown in the following table.

The test results show that the commercial blockchain A, the commercial blockchain B, the fabric all support the ledger high availability, the ledger supports the failover synchronization, the ledger backup restores, the three blockchain system ledger is reliable.

(iii) account system: Commercial blockchain A, commercial blockchain B, Fabric account reliability

The account system mainly tests an indicator: account information under different nodes is highly available. The test method is to use the script to invalidate the node of an account, use the script to conduct a simulated transfer of the account of the failed node, to check whether the transaction is successful, and if successful, the account information of the different nodes is highly available. The specific test results are shown in the following table.

The test results show that the business blockchain a, commercial blockchain B, and fabric all support the high availability of account information under different nodes, and the three blockchain system accounts are reliable.

In a comprehensive way, the blockchain network, the shared account book, the account System three aspects, the commercial blockchain A, the commercial blockchain B, the fabric are reliable. Ease of Use comparison

The convenience of blockchain mainly investigates the five aspects of Blockchain network, intelligent contract, transaction, account system and shared account.

(a) Blockchain network: Business Blockchain A network operation is the simplest, fabric second, commercial blockchain B does not support the deletion of network nodes

The blockchain network mainly tests two indexes: The complexity of network building, the complexity of adding and deleting nodes. The test method is based on the white Paper and related documents collected to build a multi-node blockchain network or delete nodes of the specific steps to simulate the construction of a multi-node blockchain network or delete nodes, calculate the time required to build and build steps or complexity of the steps or additions. The specific test results are shown in the following table.

Test results show that the complexity of network construction, commercial blockchain a fastest, within 10 minutes, fabric second, within 4 hours, business Blockchain B slowest, 8 hours or less. The complexity of adding and removing nodes, commercial blockchain A and fabric both support the deletion of nodes and do not require downtime, commercial blockchain B does not support deleting nodes.

(ii) Smart contracts: commercial blockchain A and fabric smart contracts are easy to operate, commercial blockchain B smart contract operations need to be through the central node

The smart contract mainly tests three metrics: the language supported by the smart contract, the complexity of registering the smart contract, and the complexity of deploying the smart contract. The first indicator's test method is to collect the development language supported by the smart contract according to the White Paper and related documents; The test method for the second to third indicator is to record the required process by registering or deploying the smart contract under one node, and the process requires more than 2 steps to be considered complex. The specific test results are shown in the following table.

The test results show that the three blockchain system's intelligent contracts support different languages, intelligent contract registration and deployment, commercial blockchain A and fabric are de-centralized, commercial blockchain B adopts central node, and three systems are simple in process.

(iii) Transactions: commercial blockchain A and fabric trading operations simple, commercial blockchain B trading query only support interface for

Trading main Test Two indicators: The complexity of transaction query, transaction initiation complexity. The test method is to record the required process by querying or initiating the transaction under a certain node, and the process requires more than 2 steps to be considered complex. The specific test results are shown in the following table.

The test results show that the commercial blockchain A and fabric support interface, the SDK is queried, and the commercial blockchain B supports the query of the transaction query.

(iv) Account system: Business blockchain a simple and sound operation, fabric second, business blockchain B only supports registration operations

The account system mainly tests three indicators: registration complexity, destruction complexity, authorization complexity. The test method for the first to second indicator is to record the required process by registering or destroying it under one node, and the process requires more than 2 steps to be considered complex; The third indicator is a test method that simulates the authorization of a B account to a account, records the process required for authorization, and the process requires more than 2 steps to be considered complex. The specific test results are shown in the following table.

Test results show that the business blockchain a account system is rich in ease of use, fabric second, and commercial blockchain B only supports registration.

(e) Share the book: Business Blockchain A, business blockchain B, fabric all support ledger search

Shared ledger The main test is two indicators: the search condition of the shared ledger is limited, and the index is established. The test methods for two indicators are based on white papers and related documents, specifically, the first indicator test method is to determine whether to support retrieval, if supported, simulation of the book Search, using the Script tool to calculate the average retrieval time. The second indicator test method is to determine whether the index is supported, if supported, the simulation of the shared ledger indexed to establish. The specific test results are shown in the following table.

The test results show that three blockchain systems support the search by ID, keyword, time interval, condition selection and traceability, but do not support indexing.

Overall, the blockchain network, the account system, business blockchain A is the most easy-to-use and functional, smart contracts and transactions, business blockchain A and fabric operation is the simplest, sharing accounts, three blockchain systems support ledger retrieval. Scalability Comparison

The extensibility of blockchain mainly investigates four aspects of network node, consensus algorithm, peripheral development and cloud platform integration.

(a) Network node: Commercial blockchain A and fabric network nodes are highly scalable, commercial blockchain B does not support dynamic deletion of network nodes

Network nodes mainly test three indicators: Network node dynamic increase, network node dynamic deletion, network node number limit. The three indicators are tested using white papers and related documents for expert judgment, specifically, the test method for the first to second indicator is to use the system-provided command to try to dynamically add or remove a node in the network, check whether the network state is normal after the node is added or deleted The third indicator test method is to determine whether the network node is limited, if there is a limit, how much, that is, the size of the blockchain network, through the simulation to constantly increase the number of network nodes, check the network size to reach the limit of the number of nodes, whether normal, if unlimited, by simulating uninterrupted dynamic increase network node number, Check if the network is abnormal. The specific test results are shown in the following table.

The test results show that the business blockchain A and fabric network nodes are fully extensible and scalable, and the commercial blockchain B does not support dynamic deletion of network nodes.

(ii) Consensus algorithm: commercial blockchain A and fabric consensus algorithms are highly scalable, and commercial blockchain B does not support pluggable custom consensus algorithms

Consensus algorithm mainly test six indicators: pluggable custom consensus algorithm, if the use of POW, mining difficulty can be customized. , if a POW is used, the number of blocks required to confirm that a transaction will not be revoked. , consensus algorithm according to the network scale adjustment, consensus algorithm according to the number of participants adjustment, consensus algorithm according to the transaction throughput demand adjustment. Six indicators of the test methods are through the white Paper and related documents for expert judgment, in particular, the first indicator test method is through the block chain of the reserved interface to load a custom consensus algorithm, check the network nodes to achieve consensus; the second indicator test method is to customize the mining difficulty through the interface provided by the blockchain , to test the different mining difficulty, the time required to reach a consensus is different; the third indicator test method is to determine whether to use the POW, if used, need to wait n blocks to really confirm the transaction, calculate n blocks after the transaction is discarded probability The following three indicators test method is to check whether the consensus algorithm can be customized configuration, configuration items in terms of network size, number of parties or transaction throughput adjustment parameters. The specific test results are shown in the following table.

The test results show that the commercial blockchain A and fabric support pluggable custom consensus algorithms, the consensus algorithm is highly scalable, and commercial blockchain B does not support pluggable custom consensus algorithms.

(iii) Peripheral development: Commercial blockchain A is rich in peripheral development support, fabric second, commercial blockchain B only supports SDK, API

Peripheral development Main Test three indicators: pluggable plugin, ETL, SDK and API, the first indicator test method is based on the existing plugin to install and uninstall to verify the availability of plugin; The test method for the second to third indicator is based on the provided ETL interface, SDK, API for development validation. The specific test results are shown in the table below.

Test results show that commercial blockchain a supports pluggable plugin, ETL, SDK and API development, extensibility, fabric does not support ETL development, commercial blockchain B only supports SDK and API development.

(iv) Cloud Platform integration: commercial blockchain A and fabric cloud platform integration support scope is large, commercial blockchain B cloud platform integration is missing

Cloud Platform Integration main test three indicators: integration with the cloud platform, with which cloud platform integration, provide the corresponding integration interface, the first indicator test method is the use of cloud Platform for integration verification; The second indicator is tested by different kinds of cloud platform validation The third indicator is tested by using the corresponding integrated interface for validation. The specific test results are shown in the following table.

Test results show that commercial blockchain A and fabric support integration with many mainstream cloud platforms, and provide the appropriate integration interface, business Blockchain B does not support integration with the cloud platform.

Overall, the network node, consensus algorithm, cloud platform integration, commercial blockchain A and fabric scalability, peripheral development, commercial blockchain a widely supported.