A weekly technical update on distributed technology 2016-07-31

Distributed System Practice

1. Anatomy of the Elasticsearch cluster: Distributed three C, Translog, and Lucene segments

https://mp.weixin.qq.com/s?__biz=MzA5NzkxMzg1Nw==&mid=2653160175&idx=1&sn= 3f982b5a2102f5966b512d2ad9e8e6db&scene=0&key= 77421cf58af4a6534e55141c3bdbf944a4769a7471beab65d6fd0da55e6963975707198b8befe20cfe83e51de5ca3538&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=ncwl5oxecxj2ie60h4gwrahan2mj4qbevbam26rnsl5jtk1yuwphqahzi3ksyd1t

Important: The Anatomy Elasticsearch Cluster series covers the underlying architecture and prototype examples of today's most popular distributed search engine Elasticsearch. This article is the second in this series, and we will discuss how Elasticsearch handles distributed three C (consensus (consensus), concurrency (concurrency) and consistent (consistency)) issues, The internal concepts of elasticsearch shards, such as translog (pre-write log, WAL (write Ahead log)), and segments in Lucene.

2. Near-thousand-node Redis cluster high-availability cluster case

https://mp.weixin.qq.com/s?__biz=MzAwMDU1MTE1OQ==&mid=2653547585&idx=1&sn= 9a664b16f656f757632cd4eb29f9a5dc&scene=0&key= 8dcebf9e179c9f3adc43167de5469ee441c07c6fa549314bb4ac11c9a7709ff48602d9fdde549a7ab3494ba18355e193&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=rggvdhhtyixx2xfl%2bhx0nhdwk8t%2fqyfvsvkuvgc5ioljt5o%2bksdn%2fsm772kdjndj

Important: Perhaps only Youku is using the Redis cluster scheme on line. This article summarizes the use of the pits and tuning methods of the 700-node Redis cluster cluster used by Youku, and is a very scarce use case of Redis cluster, which is worth learning.

Service and resource management technology

1. The pace of Docker: DevOps and OS

https://mp.weixin.qq.com/s?__biz=MjM5MjAwODM4MA==&mid=2650686916&idx=2&sn= 986409faad9b8cf471de9e52a376fe97&scene=1&srcid=0729zbtu0d24l4hedfirmvhb&key= 8dcebf9e179c9f3a9df68e5e9c75bda771933148607f187ddf4356bbf5fddb7c501b5d86d3820c8a9c3bb69322a0d6da&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=0vtviubn9xzfjjnrvb2bm8um%2bpuf%2bv5%2bebuvjzxejlkeqyt%2b%2bmclubmroai%2bq0kp

Key points: New vocabularies such as Docker, MicroServices, DevOps, and lean development, are filled with the entire IT industry in a relatively short period of time. This article summarizes the different phases of Docker development and highlights the new version of Docker.

2. Iqiyi's App Engine practice based on Docker

https://mp.weixin.qq.com/s?__biz=MzA5OTAyNzQ2OA==&mid=2649690916&idx=1&sn= bd2bd3ebc6205505c52e5bd0cc2eb970&scene=0&key= 77421cf58af4a653ae297c870f0c43e9da2147417ed106e2a17abe4982c2dca05c54e688a7d7ef385b6c8886d23dd08c&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=ncwl5oxecxj2ie60h4gwrahan2mj4qbevbam26rnsl5jtk1yuwphqahzi3ksyd1t

Key points: This article introduces the technology stack of Iqiyi Yi Qae Platform and the consideration of technology selection, after reading the article I think, the Qae technology selection is more appropriate, the bottom based on Mesos and Marathon do IaaS, log collection reference Cadvisor, However, the selection of service discovery and log Analysis I think there can be a better choice, here is mainly to meet the original system.

Service High Availability Technology

1. An exploration of the evolution and stability of the US-Group takeaway system architecture

https://mp.weixin.qq.com/s?__biz=MzI4NzE1NTYyMg==&mid=2651101480&idx=1&sn= dca99936779611b04bf2136616539625&scene=1&srcid=0728oxh7toxiseizut7qxxym&key= 8dcebf9e179c9f3a2e22e5804a261f03a85eec4c09d54d88e6cc270b50828dafcf9889dfd00ba389ba5d0e3074e664fa&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=0vtviubn9xzfjjnrvb2bm8um%2bpuf%2bv5%2bebuvjzxejlkeqyt%2b%2bmclubmroai%2bq0kp

Main points: Caozhen group is my friend in Shenzhen to meet, June in Beijing, the lecturer met on a long chat, looks simple and peaceful, his share in very detailed introduction of the United States in the stability of the work, including regular inspection, eye test, log collection and analysis, current limit, plan, grayscale release, we can watch Video.

2. Caching the updated routines

Http://coolshell.cn/articles/17416.html

Important: The cache can be said to be something we are very familiar with, but the cached updated design Patten may be somewhat blurred, this article on the cache updated design pattern to do a detailed summary.

DevOps Technology

1. Ali Technical Experts: The practical logic behind continuous delivery and microservices

https://mp.weixin.qq.com/s?__biz=MzI4NTA1MDEwNg==&mid=2650756192&idx=1&sn= 575154e273a909fca90b184ae6ecc017&scene=0&key= 77421cf58af4a653563f4ce6c2c1b970039d0af8ed3f90d49e1810155a61edd971f296376b5ac34fc35bff1c5f97e3b8&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=ncwl5oxecxj2ie60h4gwrahan2mj4qbevbam26rnsl5jtk1yuwphqahzi3ksyd1t

Important: This article summarizes the problems encountered in the continuous delivery process and the solutions, including how to do the tests, "other people's function is not finished", environmental management, micro-services and other content.

2. Talk about MicroServices and DevOps: How to get down to speed in practice?

https://mp.weixin.qq.com/s?__biz=MjM5MDE0Mjc4MA==&mid=2650993466&idx=1&sn= dc11f1cc96f712a3feeb43f7c364371d&scene=0&key= 8dcebf9e179c9f3aec3a20dc85a64e520ea0ce279bca7062f362e3500f080c7a77c70f88fcf57b89f1070325e17a24e2&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=bopogz5bieh4esad46abh%2bj74ptecacacv3ojggb%2bndx4zmtcrrvpashtepqaa%2fy

Key points: This article revolves around the author's practices in the areas of cloud computing related to OpenStack, Kubernetes, Microservice, DevOps, Cloudfoundry, elk, and more, from both MicroServices and DevOps, Designed to provide a fast and feasible path for both.

Hodgepodge

1.10 comment Tips for improving code readability

https://mp.weixin.qq.com/s?__biz=MjM5MzA0OTkwMA==&mid=2651194881&idx=1&sn= 4de7f1e2aee4ec0f45b4ace2167fde9b&scene=0&key= 77421cf58af4a653df7f37a3714dd39336a58e5872dfa36df85955690fe2d63be258aae7761765813beda5a28be1d398&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=erg62qbshjfkrasf9p2%2fsgqipexphjxk32fyjytljrjrzt%2bwkbocbqbjlc0mzkxy

Important: Code is for people to read, especially for posterity, if the code is poor readability, then no one will be willing to take over. Annotations are a very important part of your code, and this article describes the commenting techniques that enhance the readability of your code.

2. How to properly terminate a running child thread

https://mp.weixin.qq.com/s?__biz=MzAxNDI5NzEzNg==&mid=2651156875&idx=1&sn= 063ba2d1edda8cd7e5484906718301e0&scene=1&srcid=0724z8ndkej7imr2qgugtfrt&key= 77421cf58af4a6536a00e78d844eb41097b8b7f982a200ce5421651791daada27a3e1e1d4bad2b1db0d448dd6a948376&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=ncwl5oxecxj2ie60h4gwrahan2mj4qbevbam26rnsl5jtk1yuwphqahzi3ksyd1t

Important: Many service class programs will register a signal processing function, when it is necessary to exit the service, to do the clear processing, such as to let all the threads exit. But have you ever thought of terminating a thread? Many students may say, the direct return does not terminate it? That's true, but how does a thread sleep or be blocked? This article explains several ways to terminate a thread.

A weekly technical update on distributed technology 2016-07-31