I am concerned about the week of technical developments 2015.11.15

Distributed System Practice

1. Consistent hashing algorithm

Http://www.javaranger.com/archives/1781?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source=toutiao.io

Key points: The consistency hash algorithm is an effective method to solve the data partition of distributed system, and solves the problem that the traditional hash algorithm needs a large amount of mobile data when the machine is enlarged. This article gives a brief introduction to the consistent hash algorithm, so if you don't know the consistency hash algorithm, read this article.

2. skillfully use CAs to solve data consistency problems

http://mp.weixin.qq.com/s?__biz=MjM5ODYxMDA5OQ==&mid=400556481&idx=1&sn= 42bc187b45e4e53aece4b8c1f43e8019&scene=0&key= D4b25ade3662d64372f0fe6c3e4ff483306ddc12e35480b20594f48422dbc834a5328b249c9b08c7880593bb005a024c&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=2itnpyr6szdvzef%2brseglo1q4ksljy9opjbwnuxjfdsh2qfe8yz4s0tzftm6ui%2f6

Important: This article takes the database as an example, explains the use of CAs method to solve the data consistency problem, although the scenario in the article is usually resolved with a transaction, but for a nosql database that does not support transactions, this method is simple and effective. Beehive in the storage of ZK, is the use of ZK version mechanism for CAS, to prevent multiple users at the same time to modify the same ZK node.

3. Decrypt Apache hawq--powerful Sql-on-hadoop engine

https://mp.weixin.qq.com/s?__biz=MzAwMDU1MTE1OQ==&mid=401116165&idx=1&sn= ef4f6f04ab1caf448de770c8d52d5b19&scene=0&key= B410d3164f5f798eef87003e677f3f6ff75846c52fe9f08052c82f7c1418bd94dada351b72101d6fd7a1c245bb4dc030&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=r6pckpge0e2s4glv9xfkwcxltt2iyloosgjyv8lfo%2bbf7dcsh7cstqs%2bquqwzjaf

Important: This is the only distributed relational database engine that I've learned that supports standard SQL, and it's already open source in Apache. This article introduces the infrastructure of HAWQ, and in this paper, the design method of the distributed transaction engine is described, which is suitable for the T-level relational distributed database application. If you are interested in the follow-up students, you can get in-depth understanding and give everyone a share.

4. Kafka High Performance throughput Disclosure

Http://toutiao.com/news/6215162413189169665/?tt_from=copy&utm_campaign=client_share&app=news_article &utm_source=copy&iid=3167322395&utm_medium=toutiao_ios

Important: Kafka has been the first distributed message queue in the open source system and is used by many large internet companies, and this article explains the key technical factors for achieving high performance in Kafka.

Service and resource management technology

1. Talk about CoreOS's ETCD

https://mp.weixin.qq.com/s?__biz=MzA5OTAyNzQ2OA==&mid=400242301&idx=1&sn= df977dac103e5139c5421b357c806cf7&scene=0&key= B410d3164f5f798e53810a6d1ac00252c725223bae64cab7a57c4f58ba71081e66539f60762a0d327430ea3ac4e70f4e&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=r6pckpge0e2s4glv9xfkwcxltt2iyloosgjyv8lfo%2bbf7dcsh7cstqs%2bquqwzjaf

Important: This paper expounds the key technologies and functions of ETCD, and looks forward to some new features of ETCD 3 being developed.

2. Shopify best practices for building distributed, scalable applications

https://mp.weixin.qq.com/s?__biz=MzA5OTAyNzQ2OA==&mid=400250229&idx=1&sn= 9a40f975ac6a279776e3acea0ac4aee2&scene=0&key= B410d3164f5f798e0db4b886d5f1289eaaa8e49db6a98bfa92dfa8c8dcb0af72b7736dfea9a80a3e7fc28ec8e7d643c2&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=r6pckpge0e2s4glv9xfkwcxltt2iyloosgjyv8lfo%2bbf7dcsh7cstqs%2bquqwzjaf

Important: This paper introduces the method of Shopify building elastic platform. This article is not only interesting to read, but you can use it in practice to build your own elastic platform.

3. Docker's official white Paper on container safety

http://dockone.io/article/808

Important: In addition to the isolation and resource constraints, Docker security has always been questioned, compared to virtual machines, Docker is not as powerful as virtual machines, but it is not useless, this article describes the Docer in the container security support.

4. container Peripheral Open Source Tools rookie: Sysdig and Calico

Http://m.csdn.net/article/2015-11-08/2826147?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source= Toutiao.io

Important: The premise of applying containers is that there must be enough easy-to-use monitoring and debugging tools to facilitate op and RD tracing and location problems (which is one of the reasons why PS does not have easy access to containers, the familiar tools are gone, the accumulation of operations and monitoring is weakened), One of the 2 tools for container monitoring is for container safety.

5. an article to show you about cloud Native

Http://dockone.io/article/812?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source=toutiao.io

Key points: Mainly about cloud Native concept, background, Twelve-factor, Conway Law, how to implement Cloud Native, and VIP cloud Native practice.

Service Scheduling and Trace technology

1. Reach the secret of TENS connections-the kernel is the problem, not the solution

http://mp.weixin.qq.com/s?__biz=MjM5MDAxNjkyMA==&mid=400448462&idx=1&sn= c0b5834fd642d4006f5e463ba666cef6&scene=1&srcid=1108qg08orgpaoxvhahwztib&key= B410d3164f5f798ef6b6fbe2ff17a4819a0374611de84c0087d34b16b3f43e1e6d888fdeaac6b10244dc737a2fe03296&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=r6pckpge0e2s4glv9xfkwcxltt2iyloosgjyv8lfo%2bbf7dcsh7cstqs%2bquqwzjaf

Important: Now that the c10k problem (which also hosts the problem of concurrent connections) has been resolved, what do you do if you want to upgrade to a concurrent connection that supports tens? You might think that it's not possible, and that's not the case, now the system is capable of supporting tens other concurrent connections, just using some of the less common advanced technologies.

2. what are the basic frameworks needed to implement MicroServices

http://mp.weixin.qq.com/s?__biz=MjM5MDE0Mjc4MA==&mid=400645575&idx=1&sn= da55d75db55117046c520de88dde1123&scene=0&key= B410d3164f5f798e7e27cb441bd5082deb058434d31651bd864dad2ad3dc8764fe6ed948649bda398c14824fb22c35b7&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=r6pckpge0e2s4glv9xfkwcxltt2iyloosgjyv8lfo%2bbf7dcsh7cstqs%2bquqwzjaf

Important: This is a very good science article that allows readers to strategically advantageous position understanding of all the factors that need to be considered in order to achieve a highly available service cluster, including service discovery and service registration, load balancing, service fault tolerance, pressure control, configuration management and other technologies, as well as corresponding open source solutions.

3. 7 Recommendations for improving performance with HTTP/2

https://mp.weixin.qq.com/s?__biz=MjM5NjQ4MjYwMQ==&mid=400270444&idx=2&sn= d22e2299223cd8f1cc8c35c056278f5c&scene=1&srcid=1110aaszp4dmpmkhootilbol&key= D4b25ade3662d64348876132b4e0d51ccaf4cc3f5c0fddd42ee40c1add1f170a9fc7e825492dd42fa7d8a9c5309ec3fd&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=2itnpyr6szdvzef%2brseglo1q4ksljy9opjbwnuxjfdsh2qfe8yz4s0tzftm6ui%2f6

Key points: HTTP/2 is getting closer, more and more browsers are starting to support HTTP/2, this article introduces HTTP/2 benefits and some suggestions for applying HTTP/2.

DevOps Technology

1. Wits! A successful key business system switchover

http://mp.weixin.qq.com/s?__biz=MzA4Nzg5Nzc5OA==&mid=204934961&idx=1&sn= ef09da4a0e4af4902a0ed4e28dcdde97&scene=1&srcid=1111e0knpjyc28qniaw0noez&key= D4b25ade3662d6433b19af8baa66bd845c8914f9c2ec98071746eec95acc705fe2b8ccb19d7357bdfbc8960075862cee&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=pfhy2c65xiy5tusuk%2fkq6yddfc2jhrr81dhdierpfha0%2b98deenwxvczdmzt7pbk

Key points: The software system upgrade and evolution to a certain extent must be reconstructed or local reconstruction, but the reconstruction process is painful, both to maintain the old system to meet business needs, to resist the old system of the various drawbacks brought pressure, while thoroughly understand the old system under the circumstances of the development of a new system, Also need to get the approval of the boss and other relevant personnel, the most important thing is to control the development of risks and difficulties, to ensure the smooth migration of new and old systems, it is difficult to imagine.  Beehive refactoring on the line soon, see this article feel deeper, recall from the middle of 2014 I have the idea of beehive refactoring, until 2015 to start, until the beginning of the development test gradually finishing ready to go online, feeling a lot. And all the students need to face the new and old system of encouragement.

Tools Collection

1. From theory to practice, all-round understanding of DNS (theory)

Http://selfboot.cn/2015/11/05/dns_theory/?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source=toutiao.io

Key points: This is a very good introduction of the principle of DNS articles, in fact, a lot of technology we all seem to understand, but think and do not understand, I think for the DNS technology a lot of students also have similar situation, then please read this article.

2. A "divine map" to understand single/cluster/hot spare/disk array

http://mp.weixin.qq.com/s?__biz=MjM5ODYxMDA5OQ==&mid=400720056&idx=1&sn= 10c796793e27d475603f97b23e137c12&scene=0&key= D4b25ade3662d64324eff80e40d55c07d5167b4156ec57d14bb635d4570d593dfc9d0ca642ea459a9576690be21a6675&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.1+build (15B42) &version= 11020201&pass_ticket=2itnpyr6szdvzef%2brseglo1q4ksljy9opjbwnuxjfdsh2qfe8yz4s0tzftm6ui%2f6

Important: Map is too creative, immediately understand the various raid is what ghosts.

3. Regular expression 30-minute introductory tutorial

Http://deerchao.net/tutorials/regex/regex.htm?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source= Toutiao.io

Important: A very refined article that describes regular expressions.

4. Linux dynamic Library related knowledge collation

http://zkt.name/linuxgong-xiang-ku-de-chuang-jian-yu-shi-yong/?hmsr=toutiao.io&utm_medium=toutiao.io& Utm_source=toutiao.io

Important: The article has compiled some basic knowledge of the dynamic library, although not how to deal with the principle, but this knowledge is very common. In a large-scale distributed deployment environment, it is not recommended to use the implicit dynamic library, if used, follow the method of display (Dlopen). However, the dynamic library is more suitable to solve the problem of multi-version conflicts, especially many of the policies are developed by different teams, and many other modules depend on a large number of differences, adjust the compilation dependency is easy to cause the effect of diff, delay the development cycle. However, the compatibility of the dynamic library is not good maintenance (in this regard sofa do a lot of work, also encountered a lot of pits), encountered problems are not good location and resolution, so other scenarios are not recommended to use.

5. Supervisord's FD disclosure problem

Http://xiezhenye.com/2015/11/supervisord-%E7%9A%84-fd-%E6%B3%84%E9%9C%B2%E9%97%AE%E9%A2%98.html?hmsr= Toutiao.io&utm_medium=toutiao.io&utm_source=toutiao.io

Key points: A good example of an in-depth problem-tracking.

6. git use tutorial

Http://www.cnblogs.com/tugenhua0707/p/4050072.html?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source= Toutiao.io

Important: Git is currently the most advanced Distributed version control system, this article details Git's common operation, the company is currently mostly SVN, but also open the gitlab.baidu.com

I am concerned about the week of technical developments 2015.11.15