2018-08-11-resource & Container Management

Senior staff Engineer/architect of Sigma-usa, Hangzhou, Beijing

Job Description:

To is more specific (you is more than welcome if you is interested in one or more challenges described below):

1. Enable Sigma to response + quickly to resource requests from more than dozens of business units and even more busine SS scenarios with proper resource allocation and constraints compliance. Design a more generic architecture to enable Sigma coping with the ever-growing scale in terms of both business scenario a nd machine number.

2. Manage heterogeneous resources with Sigma, such as GPUs, FPGAs, RDMA, QAT, etc. and support innovating techniques such as Computing-storage separation, Function-as-a-service, edge-computation, stream-computation, etc.

3. Improve the stability, reliability and robustness of Sigma so, the user facing services is not affected (high Avai lability) by better handling accidents of various causes, including:hardware/software failure, Miss operation from engine ERs and even some catastrophes.

4. Based on the huge amount of information accumulated in our logs and monitors, analyze the interference between containe R instances, and help Sigma do better scheduling and rescheduling decision based on observation and an analysis of real Tim E resource (Cpu/mem/network io/etc.) consumption, app response time, and resource contention, etc. to achieve higher appli cation performance and resource utilization rate.

5. Based on current status and prediction, help making machine purchase decisions including hardware type/configuration, n Etwork structure, and deployment plans in datacenters, etc. Also, helping us design a heuristic charging and price policy for container services to guide we internal business unit U Sers towards optimal resource utilization and lower cost.

. We are looking for the future colleagues for tech leaders, architect, core developers, researchers, etc. The skill stack is listed as follows:

1. Good understanding of virtualization and/or container technology. Knowing the mechanism of namespace, cgroup, etc. in Linux. have solid knowledge in resource Scheduling/management field and being familiar with typical existing resource Managemen T frameworks, their structure, rational & concepts underlying their design. The experience of developing large scale resource management system would is a big plus.

2. Good understanding of IDC planning, network structure, server deployment, and good knowledge with CPU, memory, Disk/sto Rage. Familiar with typical computation patterns such as batch, real-time, streaming, etc. Knowledge and hands-on machine learning skills would is a big plus.

3. We would prefer candidates to has solid background in Golang and is able to handle problem independently.

4. Great expression & communication skills, and team work sprit. Being able to work with multiple teams. Good insights in technology and business evolvement and being able to make decisions on tech direction and make that Happe N.

Senior staff Engineer/architect of pouch Container-usa, Hangzhou, Beijing

Pouch is featuring strong isolation, peer image distribution, kernel compatibility, high performance as well as high resour CE efficiency. For this position, we expect candidates to improve the stability, security, and portability for pouch. To is specific (you is more than welcome if you is interested in one or more challenges described below):

1.Make pouch to able response more quickly to resource requests from more than ten business units and even more business SC Enarios with proper resource allocation and constraint compliance. Design a more generic architecture to enable pouch coping with the ever-growing scale in both business scenario and Machin E number.

2.Manage heterogeneous resources with pouch, such as GPUs, FPGAs, RDMA, QAT, etc. and support innovating techniques such as Computing-storage separation, Function-as-a-service, edge-computation, stream-computation, etc.

3.Abstract over several dozens of machines, hundreds of system-software (with several versions of kernels) and provide uni Fied and Stable container runtime for our users. Quick response to various failures, propose solutions and fix them into software distribution to being more generic whenever Possible.

4.Implement Finer grained & priority based resource isolation, including CPU, Memory, Disk io, network io, Process Han Dlers, etc So, the latency critical containers could utilize resource upon request immediately and mitigate resource Contention as possible.

5.Bring Unified user experience between VM and pouch. Improve design on transplanting existing applications this used to run in VMS or physical servers to pouch, and deal with T He difference between Os/kernel versions. Ensure compatibility with existing management tools.

6.Promote Pouch in open source community and make pouch a popular choice of container runtime. Export pouch to public cloud and other private clouds, serving more small medium enterprises and non-it focused enterprise S. Try to leads the container tech direction for the next ten years and prepare for the next generation of container Technol Ogies.

We are looking for the future colleagues for tech leaders, architect, core developers, researchers, etc. The skill stack is listed as follows:

1.We would prefer candidates to has solid background in Golang or C or Java and is able to handle problem independently. Familiar with container open source community and Linux community. With strong interest in container and other virtualization technologies. Have a deep understanding in container technology.

2.Having a deep understanding on Linux and mechanism such as namespace, Cgroup, etc. Familiar with implementation of resource isolation. Good knowledge on Linux kernel. Have the experience in developing Linux kernel is a big plus.

3.Experience such as architecture design, overseeing from design to implementation as leader independently and code Contri Bution in open source community, would all is a big plus.

4.Good Insights in technology and business evolvement and being able to make decisions on tech direction and make that HAP Pen.

CV email:eva.wang_hunter@foxmail.com