Memory Cgroups

At the same time support scheduling memory and CPU resources (default only supports memory, if you want to further scheduling the CPU, you need to make some configuration), this article describes how Hadoop YARN scheduling and isolation of these resources. In YARN, resource management is done jointly by the ResourceManager and the NodeManager, where the scheduler in the ResourceManager is responsible for allocating resources and NodeManager is responsible for providing and isolating resources. ResourceM ...

The original LXC technology was developed by IBM and has now entered the core of the Linux kernel, which means that LXC technology will be the most competitive lightweight virtual container technology at the moment, and this article will http://www.aliyun.com/zixun/aggregation/ 32779.html "> Step-by-Step introduction of how to build and manage Linux containers. The Linux distribution version used in this article is Ubuntu 12.04. LXC ...

Editor's note: The last period of time reproduced in the "5 minutes to understand docker! "Very popular, a short 1500 words, let everyone quickly understand the Docker." Today, I saw the author make a new novel, and immediately turned over. The reason to call this code reading as a fantasy trip is because the author Liu Mengxin (@oilbeater) in the process of reading Docker source, found a few interesting things: from the code point of view Docker did not start a new development mechanism, but the existing tested isolation security mechanism to use the full use, Including Cgroups,c ...

Hadoop yarn also supports two resource scheduling for both memory and CPU, and in yarn, resource management is performed by ResourceManager and NodeManager, where the scheduler in ResourceManager is responsible for allocating resources, and NodeManager is responsible for the supply and isolation of resources. 　　This article Dong Xi will introduce some of the progress of yarn in resource isolation. Author of the original: resource scheduling and resource isolation is yarn as a resource management system, the most important and most ...

With the start of Apache Hadoop, the primary issue facing the growth of cloud customers is how to choose the right hardware for their new Hadoop cluster. Although Hadoop is designed to run on industry-standard hardware, it is as easy to come up with an ideal cluster configuration that does not want to provide a list of hardware specifications. Choosing the hardware to provide the best balance of performance and economy for a given load is the need to test and verify its effectiveness. (For example, IO dense ...

As the largest Chinese search engine company in the world, Baidu offers a variety of products based on search engines and covers almost all search needs in the Chinese online world. Therefore, Baidu requires relatively large amounts of data to be processed online. Analysis, but also within the prescribed time processing and feedback to the platform. Baidu's platform needs in the Internet area to be handled by the cloud platform with better performance, Hadoop is a good choice. In Baidu, Hadoop is mainly used in the following areas: log ...

Although before heard Docker's name, but the talent is dull, to its in the end is a what thing has been puzzled, recently spent a period of time to tidy up a bit, sort out a little clue. 　　The official website introduction is such: Docker is a open platform for developers and SysAdmins to builds, ship, and run distributed applications .... Actually read ...

Since March 20, 2013 Docker appeared in front of developers, less than two years now. "Docker has transformed from a great idea into a great technology, and from a great technology to a great ecosystem, and even from a great ecosystem to a great movement." "I remember at the Docker summit in 2013, developers were still talking about Docker, and at the 2014 Amsterdam Summit, participants were already sharing its case." However, Docker's business ...

"Editor's note" Docker and CoreOS are excellent "graduates" of the Silicon Valley incubator, and it is said that two bosses have a good personal relationship, Docker do container engines, CoreOS container management, cooperation is very happy, but with the release of Rocket gradually "parted". Although Docker and CoreOS are seeking "Jane", but Docker "Jane" is to strive to achieve the most convenient use of the user, CoreOS "Jane" is the pursuit of the ultimate lightweight, which will be the future of container technology, in fact, it is difficult ...