Contributions from a group of students--high-performance extensible Python automation and operations framework

Source: Internet
Author: User
Tags ssh access

reboot operation and development of thousands of people (365534424 ) will be full

encounter bottlenecks :

1, has been using python Write a variety of scripts, want to do automated operation and maintenance platform but powerless, have not seen the large operation and maintenance platform how to do,

2, the script of their own in the large scene is not reliable, whenever the discussion of some data based on SSH access to perform the operation of the way will be despised.

Enlightened :

Confused half a year can not find the direction, recently in the reboot system learning under, a lot of, a lot of doubts and difficult problems finally solved.

Thanks to the PC teacher for explaining the program's in-depth explanation of the use of the system [cpu\ memory utilization \ System characteristics] and how to define the network programming private protocol.

Several typical open source software source code of the network model analysis, how to really control multi-threading, how the Daemon fork, encapsulation socket non-blocking framework, how to develop a transport protocol.

works show:

  • Monitor and execute command flowchart

    650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/04/wKiom1WPY_zQDscmAAHzFIomllI171.jpg "title=" 1.jpg " alt= "Wkiom1wpy_zqdscmaahzfiomlli171.jpg"/>

  • Software catalog [one server per minute as needed]
  • 650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/04/wKiom1WPZlWyPqfkAARkVAneSRo480.jpg "style=" float: none; "title=" 2.jpg "alt=" Wkiom1wpzlwypqfkaarkvanesro480.jpg "/>

    Transfer data for the Task Control service

    650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M00/6F/00/wKioL1WPaBfAptUvAAP7oOxWNco661.jpg "style=" float: none; "title=" 3.jpg "alt=" Wkiol1wpabfaptuvaap7ooxwnco661.jpg "/>

    Flask request log for Data interface

    650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/00/wKioL1WPaBeQCK1dAALrg-QE7rU855.jpg "style=" float: none; "title=" 4.jpg "alt=" Wkiol1wpabeqck1daalrg-qe7ru855.jpg "/>

  • The agent's execution log

    650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M00/6F/04/wKiom1WPZljCc8nuAAWOWsJ7_mY203.jpg "style=" float: none; "title=" 5.jpg "alt=" Wkiom1wpzljcc8nuaawowsj7_my203.jpg "/>

  • Agent of 4 threads, can arbitrarily expand arbitrary

    650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M01/6F/00/wKioL1WPaBiiydheAAKyWCOinQU362.jpg "style=" float: none; "title=" 6.jpg "alt=" Wkiol1wpabiiydheaakywcoinqu362.jpg "/>

  • Background request page and data interface

    650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M01/6F/04/wKiom1WPZlmhdtU9AAYHurd6u2w951.jpg "style=" float: none; "title=" 7.jpg "alt=" Wkiom1wpzlmhdtu9aayhurd6u2w951.jpg "/>

  • Page Ajax Call Data interface

    650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/00/wKioL1WPaBmz3RYNAAOoQm9q0w4354.jpg "style=" float: none; "title=" 8.jpg "alt=" Wkiol1wpabmz3rynaaooqm9q0w4354.jpg "/>




  • Monitor data out diagram
  • 650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/04/wKiom1WPZlmzk6htAAEy_ZDoVk8245.jpg "style=" float: none; "title=" 9.jpg "alt=" Wkiom1wpzlmzk6htaaey_zdovk8245.jpg "/>

  • The previous data, 6 servers at the same time running on a machine, no pressure, the monitoring chart is not good-looking .... I'm going to get hundreds of concurrent shell processes running and putting load on.
  • Execute command

    Make an AJAX request, agent asynchronous processing, return to the library, and then use AJAX dynamic call database API display

  • 650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M00/6F/00/wKioL1WPaBmwynchAAKYmIduKQg139.jpg "style=" float: none; "title=" 10.jpg "alt=" Wkiol1wpabmwynchaakymidukqg139.jpg "/>

Summary:

This architecture is very flexible, arbitrary disassembly splicing, if small, can function integrated in a little, if large, can arbitrarily expand the bottleneck, the server All Daemon way.

These are the results of this period of study, a lot of excellent details can not be fully demonstrated, interested in contact reboot Operations Development Group (365534424)



This article is from the "Reboot DevOps Development" blog, please be sure to keep this source http://opsdev.blog.51cto.com/2180875/1668681

Contributions from a group of students--high-performance extensible Python automation and operations framework

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.