A weekly technical update on distributed technology 2016.08.07

Searcher Distributed portraitThe main areas covered by the direction include the theory of distributed systems and design practices,Resource Management and virtualization technologies, large-scale service stability technology Devops,  "distributed direction one week technology dynamic " is a featured technical article on distributed direction that I summarize and organize weekly hope to enable you to follow the industry-related technology dynamics , ,  Learning Distributed system theory and design ideas ,  support everyone's daily work .  Weekly technical developments will be released hi welcome everyone to read .   distributed technology dynamic   have any comments or suggestions ,  You can always contact me

Hi Group : 1478429

Mail group : [email protected]

Previous list: Distributed direction one week technical news

Distributed System Practice

1. Distributed Queue Programming: Model, Combat

Http://tech.meituan.com/distributed_queue_based_programming.html?hmsr=toutiao.io&utm_medium=toutiao.io &utm_source=toutiao.io

Point: The queue as a basic data structure, widely used in various software, especially the development of distributed systems, distributed queue programming model almost everywhere. This paper introduces several common programming models and design ideas of distributed queue, and does not involve the implementation of distributed queue.

2. Design of the same travel buffer system: How to build the perfect system in the Redis era

http://mp.weixin.qq.com/s?__biz=MzAwMDU1MTE1OQ==&mid=2653547622&idx=1&sn= 199cd6d8e3dff7c839935a7613d43e76&scene=0#wechat_redirect

Key points: This article from the same Cheng Travel chief architect Linda, Xiao Bo is i in this year's Shenzhen Archsummit lecturer meeting will be the time to meet, warm and humble, technical foundation deep. Know Redis's classmates know, although Redis is a very excellent memory storage system, but in the cluster is always relatively weak, although there are Codis, Twmeproxy, Redis cluster and other solutions, but there is always an unsatisfactory feeling. This article introduces the "Phoenix" cache system, which is based on the Redis protocol, which solves the operational problems such as data expansion, monitoring and cluster management. It can also be seen that a highly available distributed system must be designed to consider the operation of the problem, in order to truly high availability.

Service and resource management technology

1. Uncover Google's management technology behind 2 billion + containers per week

https://mp.weixin.qq.com/s?__biz=MzA4NTU2MTg3MQ==&mid=2655158150&idx=1&sn= de7c2b7162776b659b909390e646d01d&scene=0&key= 8dcebf9e179c9f3abf32caf0eb5dfc3ec041f55e7f207ef7b2dcdd2698f9b7614b31505c9e5e35d14097cf0e1cbafaa3&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=jwwev%2bcd5fytiu5mwu%2bgrcglui2qpnf3eoqe8agn9g8yehb8btpm%2bjik8lfswney

Important: In terms of cluster management, Borg and k8s are well-known, but supporting Google's large data centers requires many other infrastructure, such as machine-on-line, fault detection and repair, and configuration management. This article summarizes the management process of Google's machines and services, from the machine shelves to the whole process of service deployment.

2. Docker practices in traditional financial enterprises

https://mp.weixin.qq.com/s?__biz=MjM5NzAwNDI4Mg==&mid=2652190935&idx=1&sn= a2cc5918fc6ba42b5f851f67d7515223&scene=0&key= 8dcebf9e179c9f3ae09b42bfdb5774cc6d3c63ce08a287ac960e7f06150242aaf74220c8a6650b49090f74394556dcad&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=fijstjwfvbmhrm7eb1gcghxpm2b4huv1fdyzj0nuodxxxw639n4rhlcjo6fprjqy

Important: With the popularity of Docker technology, the concept of container cloud is gradually known. Docker-based container cloud-padis has been developed, tested, and produced to address the long-time problem of safe, traditional application delivery. Padis solves the problem of standardization of middleware, which greatly shortens the time of delivery. Here is a Wang Yaowu on the archsummit of the Ping an container cloud platform at the seven Qiniu session of the Global Architect Summit at the Padis.

Service High Availability Technology

1. What if the performance is not good? I'll go through the list.

https://mp.weixin.qq.com/s?__biz=MzAwNjY4NTQ4MA==&mid=2651174290&idx=1&sn= 288518f030801f4d90878e806546487c&scene=1&srcid=07311hc8aup9xaoyrv8pdcp9&key= 8dcebf9e179c9f3a6b15ced3c46d2b1c191020d01406c4efa6c915f6b44abe32fdbf86cb3ed0bd00a5d53ce30ff2faca&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=%2b%2fmhk3tupm6yzxz2ioojx%2bjvdeqagvb2qypdsmswimdlhihh9b7fhzhstbqjqs5u

Important: Brendan Gregg is a senior performance architect for Netflix and a renowned performance tuning expert. Not long ago, Brendan Gregg in SREcon16 shared the "performance checklists for SREs", is also a dry full. Let's see it together.

DevOps Technology

1. Application standardization model and practice of continuous delivery

https://mp.weixin.qq.com/s?__biz=MzA4NjAzMjEyOA==&mid=2654565193&idx=1&sn= 9510f1cd7e12ccd1d00de8da0846a6eb&scene=0&key= 8dcebf9e179c9f3af19ce134d450ce733198e22980994e33e6e133d09e2c07246bc3f2db520386d255da1c3e7511c47b&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=jwwev%2bcd5fytiu5mwu%2bgrcglui2qpnf3eoqe8agn9g8yehb8btpm%2bjik8lfswney

Important: There is standardized automation is the platform, no standardized automation is the tool! This paper summarizes the author's design and application of standardized models and practices in continuous delivery.

2. How do you understand the term "devops" after 8 years of speculation?

https://mp.weixin.qq.com/s?__biz=MzA5Nzc4OTA1Mw==&mid=2659597867&idx=1&sn= 10f7c2f5907f26563cc9682e474fed11&scene=0&key= 8dcebf9e179c9f3a140450af8f306bb963cc246875921b807a57072878f610a816df280f3060b8eff96a33566d383c12&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=iiy4t1fmwdgq%2bclwb7omyxdg4beibg9ybhmuxggfgt6p5osnimwsyw8gg5m48ojb

Important: DevOps has always been a rather virtual word, with no definite meaning. This article summarizes the author's understanding of DevOps, points out some misunderstandings of cognition, and sums up the suggestions of implementing devops from the aspects of organization, technology and process. I think the author's understanding of DevOps is very profound and deserves our learning.

Hodgepodge

1. A complete beginner's Guide to machine learning, deep learning and AI

http://geek.csdn.net/news/detail/90973

Important: Machine learning, AI can now be said to be a very hot field, but for our architecture engineers, these seem very advanced, this article is a beginner's guide to AI, hoping to let everyone learn from perceptual AI.

2. Inter-process communication for Linux-file and file locks

https://mp.weixin.qq.com/s?__biz=MzIxNDMyODgyMA==&mid=2247483716&idx=1&sn= 01ce60d159216f322a65c71aa9c07dc4&scene=0&key= 8dcebf9e179c9f3a8b3606b2791039c29bcf97a8891d529e6adf829ae7c5bb028522045b0261fb39e9c0e4df87aae6dc&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.5+build (15F34) &version= 11020201&pass_ticket=03astcd85nglwd8skhuwgv1u9%2b2j649jv3fbw3jnj4zfv9i0sik7zvv1hf1tz%2b%2fh

IMPORTANT: If multiple processes read and write the same problem at the same time, how do you guarantee mutual exclusion? Some students may say that using the flock function or the LOCKF function, then what is the difference between them, when using the pit? This article provides a detailed description of the content.

A weekly technical update on distributed technology 2016.08.07