A weekly technical update on distributed technology 2016.01.17

Distributed System Practice

1. Apache HBase 2015 Development Review and future prospects

https://mp.weixin.qq.com/s?__biz=MzAwMDU1MTE1OQ==&mid=403219545&idx=1&sn= 119613ae7d52de9c033b3ed0598bae6a&scene=0&key= 41ecb04b05111003bd0affa70f2b91e7b66a30a4d6c249144a35c4803953e9154f772362b0679fc707dd38f14dc1966f&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=iglbdanh9qdl60yhlb3zxwxkmo%2fcd3%2foeme4pzl7ypuotj2ztzwtsbesmkj9lczv

Important: We've sorted out many of the major changes in HBase 1.0, and have looked ahead to the future of HBase.

2. Fast Taxi architecture Practice

http://mp.weixin.qq.com/s?__biz=MjM5MjAwODM4MA==&mid=402041851&idx=1&sn= 10e83c9dc614ae36bba63da9d5614b86&scene=0#wechat_redirect

Key points: This article introduced the Fast Taxi architecture evolution process, including the long-connection service stability, the system distributed transformation, the wireless platform construction, the real-time computation and the monitoring and so on, in fact these infrastructure facilities many students are quite familiar, but how to apply these infrastructure facilities to meet the rapid growth of business needs is worth learning.

3. Do you want to change from RabbitMQ to Kafka in vernacular IT?

https://mp.weixin.qq.com/s?__biz=MzA3MjEyNTE4MQ==&mid=403459151&idx=1&sn= 640ba3d9ea70e23ace8b99aff764e42f&scene=0&key= 41ecb04b051110032817c86c43584090638b3811188f90782f3aa74f5f09782c38a56ab000336957c4f6bc924c128543&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=neohdejipqwvpt31utipsrwo8jh1d%2b24pu7mkj5xwy9hmrak3j3wvt6auqssil2m

Key points: A brief comparison of Kafka and RABBITMQ to help you with the architecture selection.

4. Sharing of large-scale distributed system architecture practice cases--apache Eagle

https://mp.weixin.qq.com/s?__biz=MzAwNjQwNzU2NQ==&mid=401502064&idx=1&sn= d19e016958ad36f3a7bc85e59c345779&scene=0&key= 41ecb04b05111003797eedb95fb810ecae970b4a7aa6e81d04a7e0a738756f109ee3e2f5577a952929934c8d9469b033&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=neohdejipqwvpt31utipsrwo8jh1d%2b24pu7mkj5xwy9hmrak3j3wvt6auqssil2m

Important: Eagle is an efficient and distributed streaming strategy engine developed by ebay, which features high real-time, scalable, easy to scale, interactive and friendly, and integrates machine learning to build user portraits for historical model training to enable intelligent real-time protection of big data in the Hadoop ecosystem.

5. Deep understanding of optimistic lock and pessimistic lock

https://mp.weixin.qq.com/s?__biz=MzAwNjQwNzU2NQ==&mid=401540725&idx=1&sn= 3eddb881084872aa8f49e43b5ac3183e&scene=0&key= 41ecb04b05111003eaacd5a209d56b7defe95a420e5978f3af6b968cbf72dbe0487c75fa191a9a2a9f45870543b47f5d&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=cieolc0zznqwrk7okbssljy8izyf5a5w4cl3hbm3az5atb3xtlvhvr%2fdn6d7r4jy

Key points: Optimistic lock and pessimistic lock is a resource coordination mechanism used in distributed system design, and the design idea and application scenario of optimistic lock and pessimistic lock are explained in detail in this paper.

Service and resource management technology

1.10 minutes to take you to understand kubernetes core concepts

https://mp.weixin.qq.com/s?__biz=MzA5OTAyNzQ2OA==&mid=401295665&idx=1&sn= c7c698c0a79fa89ba6e47f794182ece8&scene=0&key= 41ecb04b05111003245cae932300689248dec19dd3f49efbc4f50564e705dbb26951846cb0708d651e4dd8045d75f654&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=iglbdanh9qdl60yhlb3zxwxkmo%2fcd3%2foeme4pzl7ypuotj2ztzwtsbesmkj9lczv

Important: Kubernetes's brief introduction, if you have known k8s before, then this paper is not new to you.

2. In layman's kubernetes

https://mp.weixin.qq.com/s?__biz=MzA5OTAyNzQ2OA==&mid=401295665&idx=2&sn= aec095d2ba84eb9ba5035b4db3786595&scene=0&key= 41ecb04b051110036b56b9ae40de9e684839123687f01b8af0152c93f15f9b7ddb1ea24996538e217499beb4d759f412&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=iglbdanh9qdl60yhlb3zxwxkmo%2fcd3%2foeme4pzl7ypuotj2ztzwtsbesmkj9lczv

Key points: This paper is a deep analysis of k8s, the author through a series of experiments to verify k8s behavior, especially for k8s autoscaling ability, is a rare learning k8s good text.

3. Six signs of the full rise of container technology in the 2016

https://mp.weixin.qq.com/s?__biz=MzA5OTAyNzQ2OA==&mid=401323121&idx=1&sn= ea50a2777651903efeda05a7bd04c509&scene=0&key= 41ecb04b0511100302562148fe2da8b5800291e349380ca7eb6cac2e45658a4d66a3362ff7267923d6e956e027ff3a5a&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=cieolc0zznqwrk7okbssljy8izyf5a5w4cl3hbm3az5atb3xtlvhvr%2fdn6d7r4jy

Important: It is almost certain that container technology will continue to reshape the IT landscape in the coming year, and here we will look at some of the important signs that are about to come true next.

High-availability technology for large-scale services

1. In-depth understanding of synchronous/asynchronous versus blocking/non-blocking differences

https://mp.weixin.qq.com/s?__biz=MzAwMDU1MTE1OQ==&mid=403270751&idx=1&sn= 7269cd113d7b85e407319036d61ef786&scene=1&srcid=0108m9gcq2ojdhdzfawzsir7&key= 41ecb04b05111003b9ed13bb24ad814e723252b44842b1d6584b1820a8742196cc43437d184e412a13dd67cf2939b4e5&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=l4ntu%2b%2fwv9jgxduhoqqylet7nhjw%2f2shav4r7o5l9mqfw3nuhnxmfayasa%2bjxwhm

Important: As long as the work you have done is synchronized, regardless of whether you set the callback function. As long as it is delegated to others, it is asynchronous.

2. What are the basic frameworks we need to implement micro-services?

https://mp.weixin.qq.com/s?__biz=MzA5Nzc4OTA1Mw==&mid=407641457&idx=1&sn= 183d27056f3bd8ef17e77a3c15dfb3dd

Key points: micro-service infrastructure in detail, the article finally listed Netflix micro-service architecture Open Source solution for you to learn and reference.

DevOps Technology

1. "Tomato Garden" for Ops: Open source X86 Server Configuration Installation Tool Preview

https://mp.weixin.qq.com/s?__biz=MzA4Nzg5Nzc5OA==&mid=401627443&idx=1&sn= 4f0505bb8509dc0eba3dc93c6d97a0b3&scene=0&key= 41ecb04b0511100369415a516d35bbdc991714833d59350606ad6f239c0c87eca3108cdcff088cd74e0fece05364dd63&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=iglbdanh9qdl60yhlb3zxwxkmo%2fcd3%2foeme4pzl7ypuotj2ztzwtsbesmkj9lczv

Important: This article introduces an open source system that helps operators fully automate the batch installation of servers.

2.20 command-line tools to monitor the performance of Linux systems

https://mp.weixin.qq.com/s?__biz=MzAxODI5ODMwOA==&mid=413419308&idx=2&sn= 3fdc0ddf3a380e78fc634afc18eec311&scene=1&srcid=0104eyfxem9lrmktzzosylw7&key= 41ecb04b05111003d6861785741f51713a83fe5ecfac9f49618f4bd75affdb92cebc697b4ef310557acdff439d6ce00b&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=iglbdanh9qdl60yhlb3zxwxkmo%2fcd3%2foeme4pzl7ypuotj2ztzwtsbesmkj9lczv

Important: 20 small tools to monitor Linux performance.

3. Decoding YY Interactive operation | Practice of continuous deployment platform based on DevOPS concept

https://mp.weixin.qq.com/s?__biz=MzAxOTAzMDEwMA==&mid=403526650&idx=2&sn= c6f89d4fb1cb44ff6f18bb47b29f9f55&scene=0&key= 41ecb04b05111003eca1b7413fbd1c4fa1e6d66fccbf0f351dd64780d9a3a29a12fecdbeaf57537b839571c9096b62f3&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=cieolc0zznqwrk7okbssljy8izyf5a5w4cl3hbm3az5atb3xtlvhvr%2fdn6d7r4jy

Key points: This article shares the YY interactive games dimensional plane platform DevOps concept and self-developed "dragon" continuous deployment platforms, and the use of virtualization to achieve a scalable operation and maintenance concept.

4. talking about the idea of automatic operation and maintenance design

https://mp.weixin.qq.com/s?__biz=MzA4Nzg5Nzc5OA==&mid=401724680&idx=1&sn= f71dcd472e5b22d4fb11a8d27abec13e&scene=0&key= 41ecb04b05111003c0e3e7b6e6b0381adfec6bbf041195b9411b0de255fa23a6511da976d0d637d270a8babc3714eefa&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=5hp7yramp2los2wk7n0zpoc8tvklbcyismhi53cugu9waj5yvrt11gttptsf%2boa5

Key points: This paper briefly expounds the four Modernizations principles that the author believes should be followed: Management system, workflow, personnel specialization and task automation.

Hodgepodge

1. Post-modern system programming language--c++

Http://insights.thoughtworkers.org/coding-language-c/?hmsr=toutiao.io&utm_medium=toutiao.io&utm_source =toutiao.io

Important: As a classic programming language, C + + has been widely used in the field of system development and high performance computing since the 80 's. In recent years, with the rise of various programming languages and paradigms, C + + 's figure gradually faded out of people's horizons. But as a language that is still progressing, C + + has developed rapidly in recent years, has possessed the characteristics of modern language, and also has a lot of existing and ongoing new expansion.

2. How Browsers

http://blog.csdn.net/zzzaquarius/article/details/6532299

Important: A very detailed introduction of the browser of the article, which also introduces a lot of detailed HTML and CSS details, rare Good article recommended to everyone.

3. Summary of Linux knowledge points

Https://blog.huachao.me/2016/1/Linux%E7%9F%A5%E8%AF%86%E7%82%B9%E5%B0%8F%E7%BB%93/?hmsr=toutiao.io&utm_ Medium=toutiao.io&utm_source=toutiao.io

Key points: The Linux operation and maintenance of common knowledge points, and there are many quotations, recommended reading.

4. Python's flake8-coding style check automation tool

https://mp.weixin.qq.com/s?__biz=MzA3OTgyMDcwNg==&mid=401862197&idx=1&sn= 179ad363b088f4413469573d972db285&scene=0&key= 41ecb04b05111003cfc33a3b4fed74bfd613c6146d697542cb8c215a1d75a49a73b795affcfa11bc27b251cf15f92bb3&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=neohdejipqwvpt31utipsrwo8jh1d%2b24pu7mkj5xwy9hmrak3j3wvt6auqssil2m

Important: Python as a dynamic language, although the development of high efficiency, but because there is no need to compile, syntax errors and exceptions are often found in the runtime, which poses a great challenge to stability, this article describes the automated Check tool, can help you to advance the discovery of semantic errors in Python.

5. 5 Rules for Java logging

https://mp.weixin.qq.com/s?__biz=MjM5NzMyMjAwMA==&mid=402404856&idx=1&sn= 6e8d1dd9d7a31b636df64dbf863f1644&scene=1&srcid=0107c1j92myzyhld1kdq5pzu&key= 41ecb04b05111003a93bb25ec1f9c9b2fa2fd70468e754d17f04b5340bdbf596b0c6944874c0c0cf80b8ed4c7ad4f6d6&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=cieolc0zznqwrk7okbssljy8izyf5a5w4cl3hbm3az5atb3xtlvhvr%2fdn6d7r4jy

Important: The diagnostic log can be said to be our log tracing problem is the most significant means, but to write a good diagnostic log is still a rule, although the title of the article is for Java, but I think it can be targeted in any language.

6. Understanding the return value of the C language system function

https://mp.weixin.qq.com/s?__biz=MzAxNjM3MDkyOQ==&mid=401553888&idx=1&sn= 2f0b358e5e766f9fbdaa03fc5a62061c&scene=1&srcid=0107houunfsm0safqmhpayes&key= 41ecb04b05111003d2ea40db1bc4c826aaa3c7a29a920d27c49f56c5b8ee33bdb800b03c5b03e82799a3f71149c57cd2&ascene=0 &uin=mjk1odmyntyymg%3d%3d&devicetype=imac+macbookpro11%2c4+osx+osx+10.11.2+build (15C50) &version= 11020201&pass_ticket=cieolc0zznqwrk7okbssljy8izyf5a5w4cl3hbm3az5atb3xtlvhvr%2fdn6d7r4jy

Point: Do you really understand the return value of system? After reading this article, answer me.

A weekly technical update on distributed technology 2016.01.17