A weekly technical update on distributed technology 2016-06-12

Distributed System Practice

1. An in-depth discussion of the Byzantine general

Http://www.8btc.com/baizhantingjiangjun?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source=toutiao.io

Main points: The Byzantine general problem and the two armies problem is the classical problem of the distributed system consistency theory, this article has carried on the thorough analysis to the Byzantine general Problem solution algorithm, has helped everybody to understand the difficulty which realizes the distributed consistency more deeply.

2. Apache Cassandra Architecture Understanding

https://mp.weixin.qq.com/s?__biz=MzAwNjQwNzU2NQ==&mid=2650342707&idx=1&sn= 3a67dcf49f9218ef50fdcde43cfff2f2&scene=0&key= 8d8120cb97983fad4929c1afb3501d05d33c5a17036eeee1b0caa61f1fd4e2cab6c5ba0b8df242530323086d381b5cf2&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=poezh8kovi7watrpcidum6vndn%2flihbdktqrp9ufkfmuuv%2bmcvz%2bhtloyrg5vymb

Important: Cassandra is an open source implementation of Amazon Dynamo paper. Dynamo more daring to introduce the decentralized design, using gossip, consistency hash, vector clock and other distributed theory and technology, so Dynamo has a high theoretical value. However, decentralized distributed systems engineering implementation is more complex, in practice, it is recommended that the preferred conventional centralized +ha design ideas. This article outlines the architecture of the Cassandra and assists us to strengthen our understanding of dynamo.

3. In-depth understanding of 2PC and 3PC of distributed systems

http://www.hollischuang.com/archives/1580

Points: 2PC and 3PC I think a lot of classmates are not unfamiliar, but the various abnormal branches are very difficult to understand, this article introduces the various abnormal branches of 2PC, and in response to these problems, explains how 3PC is resolved.

Service and resource management technology

1. Mesos+zookeeper+marathon+docker Distributed cluster Management best practices

https://mp.weixin.qq.com/s?__biz=MzI4NTA1MDEwNg==&mid=2650755658&idx=1&sn= 9f5e4831b2c27d66e4296c49ffcd3d7c&scene=0&key= 8d8120cb97983fadf0b10d786c02beadef9073f97737986db966892e3c781775feb81325fa17bdd7ef6422c1dbd4d849&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=poezh8kovi7watrpcidum6vndn%2flihbdktqrp9ufkfmuuv%2bmcvz%2bhtloyrg5vymb

Important: Mesos+marathon+docker is the preferred PAAs platform for many startups, this article describes the steps to build these services, and the beginners can refer to them.

2. Comparison of key technologies for container technology resource scheduling

http://jm.taobao.org/2016/05/06/the-container-resource-scheduling-tech-comparison/#

Key points: This article detailed analysis of Mesos, Borg, k8s and other typical resource management system resource scheduling technology, including resource preemption, auctions, super-hair and so on.

3. Docker-based micro-service architecture test water

https://mp.weixin.qq.com/s?__biz=MzI4MjA4ODU0Ng==&mid=2650910910&idx=1&sn= a4e1fcad7eecdba08b21aaf204465a91&scene=0&key= 8d8120cb97983fadf98726cf3e1069d86b0a0a9b7262b790d3ebc560290c543afa80df2a9a4d8ccd0756451958279921&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=rord7qzwgf5gv2ehv8p01g8urrwq17k5z6odh1oma7%2fir974hjrdmo10jqjrbbcc

Important: Choose a microservices architecture and Docker must be careful, consider the pros and cons of each side, this article summarizes the author in the introduction of micro-service and Docker process, stepping on the pits, it is worth reference and reference.

Service High Availability Technology

1. I am serious: Linux SWAP Depth interpretation

https://mp.weixin.qq.com/s?__biz=MzA4Nzg5Nzc5OA==&mid=2651660097&idx=1&sn= a3d38e3af2c9d8d431c46fe7680b428d&scene=0&key= 8d8120cb97983fadc32e9ab99b5a2f80a9ae2f7502fe7bad46990570406523b51f0fed86224573ef1e7b55a2ef27750e&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=poezh8kovi7watrpcidum6vndn%2flihbdktqrp9ufkfmuuv%2bmcvz%2bhtloyrg5vymb

Important: This article analyzes the technical details of Linux swap management in detail, but we are switching off the swap online, and many students may not notice it.

2. Pit Series---high-availability architecture for silver bullets

https://mp.weixin.qq.com/s?__biz=MjM5ODczNTkwMA==&mid=2650107084&idx=1&sn= e1c64ab5006df4118d4b9b6d8642d9d4&scene=0&key= 8d8120cb97983fad6dd7410970043383837619639b24b44ac6b2bb6c709b3d21012f08b344d399facfa79cb22aaefaa4&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=zodt5qinxr6jboufdw9k3ipxdqkqsanip4b8nu9c6lrtfttj0bnvch2rujmwnmjh

Important: With the growing trend of the open source community, it is becoming easier to realize a "high availability" architecture. But do high-availability architectures really have silver bullets? The author points out that if there is a silver bullet, good code is the cornerstone of all high-availability architectures and silver bullets, good code plus a reasonable architecture is a highly available architecture, a highly available architecture is not built on the building blocks of open source software, the mature open source software solves the part of the code that should have been written by you to become more excellent. Therefore, we hope that everyone from the point of view of their own code to write good every line of code.

DevOps Technology

1. Drip operation standardization practice two or three

https://mp.weixin.qq.com/s?__biz=MzA4Nzg5Nzc5OA==&mid=2651660158&idx=1&sn= 858f86d573f68cf18d548822c90ef85c&scene=0&key= 8d8120cb97983fad398bde15d995f676cffd7d6923de23a5ec331269b07847070294926679ec8adcd273b897d0e62d30&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=rord7qzwgf5gv2ehv8p01g8urrwq17k5z6odh1oma7%2fir974hjrdmo10jqjrbbcc

Important: The lack of standardized operations is destined to be tragic, this paper describes the drip in the configuration management, monitoring indicator output and on-line deployment of standardized practices.

Hodgepodge

1. Facebook Open source software list

http://mp.weixin.qq.com/s?__biz=MzA5Nzc4OTA1Mw==&mid=2659597383&idx=1&sn= a867ee13f294d38d02313a4c58d3da48&scene=1&srcid=06056gdf0vd6jp3k7afdizsn&from=groupmessage& Isappinstalled=0#wechat_redirect

Important: Facebook has been active in the open source community, and these open source software look for what you want?

2. core files for Linux

https://mp.weixin.qq.com/s?__biz=MzAxODI5ODMwOA==&mid=2666539186&idx=1&sn= d9a475ee8db151b094f19c5b64b8b434&scene=1&srcid=0609jfxsfbjj4qah6hswee5w&key= 8d8120cb97983fad47e6a1f1007d2e6df761c975a676e36c778e2895e25c1c9ba730a3be27ad61e2b15ecab8b9709dd9&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=rord7qzwgf5gv2ehv8p01g8urrwq17k5z6odh1oma7%2fir974hjrdmo10jqjrbbcc

Important: The core file can be said to be a black box of diagnostic crashes, this article describes the control core file output parameters, you can modify the location of the core file and file naming.

A weekly technical update on distributed technology 2016-06-12