Contributions from a group of students--high-performance extensible Python automation and operations framework

reboot operation and development of thousands of people (365534424 ) will be full

encounter bottlenecks :

1, has been using python Write a variety of scripts, want to do automated operation and maintenance platform but powerless, have not seen the large operation and maintenance platform how to do,

2, the script of their own in the large scene is not reliable, whenever the discussion of some data based on SSH access to perform the operation of the way will be despised.

Enlightened :

Confused half a year can not find the direction, recently in the reboot system learning under, a lot of, a lot of doubts and difficult problems finally solved.

Thanks to the PC teacher for explaining the program's in-depth explanation of the use of the system [cpu\ memory utilization \ System characteristics] and how to define the network programming private protocol.

Several typical open source software source code of the network model analysis, how to really control multi-threading, how the Daemon fork, encapsulation socket non-blocking framework, how to develop a transport protocol.

works show:

• Monitor and execute command flowchart

  650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/04/wKiom1WPY_zQDscmAAHzFIomllI171.jpg "title=" 1.jpg " alt= "Wkiom1wpy_zqdscmaahzfiomlli171.jpg"/>

• Software catalog [one server per minute as needed]

• 650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/04/wKiom1WPZlWyPqfkAARkVAneSRo480.jpg "style=" float: none; "title=" 2.jpg "alt=" Wkiom1wpzlwypqfkaarkvanesro480.jpg "/>

  Transfer data for the Task Control service

  650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M00/6F/00/wKioL1WPaBfAptUvAAP7oOxWNco661.jpg "style=" float: none; "title=" 3.jpg "alt=" Wkiol1wpabfaptuvaap7ooxwnco661.jpg "/>

  Flask request log for Data interface

  650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/00/wKioL1WPaBeQCK1dAALrg-QE7rU855.jpg "style=" float: none; "title=" 4.jpg "alt=" Wkiol1wpabeqck1daalrg-qe7ru855.jpg "/>

• The agent's execution log

  650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M00/6F/04/wKiom1WPZljCc8nuAAWOWsJ7_mY203.jpg "style=" float: none; "title=" 5.jpg "alt=" Wkiom1wpzljcc8nuaawowsj7_my203.jpg "/>

• Agent of 4 threads, can arbitrarily expand arbitrary

  650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M01/6F/00/wKioL1WPaBiiydheAAKyWCOinQU362.jpg "style=" float: none; "title=" 6.jpg "alt=" Wkiol1wpabiiydheaakywcoinqu362.jpg "/>

• Background request page and data interface

  650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M01/6F/04/wKiom1WPZlmhdtU9AAYHurd6u2w951.jpg "style=" float: none; "title=" 7.jpg "alt=" Wkiom1wpzlmhdtu9aayhurd6u2w951.jpg "/>

• Page Ajax Call Data interface

  650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/00/wKioL1WPaBmz3RYNAAOoQm9q0w4354.jpg "style=" float: none; "title=" 8.jpg "alt=" Wkiol1wpabmz3rynaaooqm9q0w4354.jpg "/>

• 
  
• 
  
• 
  
• Monitor data out diagram

• 650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M02/6F/04/wKiom1WPZlmzk6htAAEy_ZDoVk8245.jpg "style=" float: none; "title=" 9.jpg "alt=" Wkiom1wpzlmzk6htaaey_zdovk8245.jpg "/>

• The previous data, 6 servers at the same time running on a machine, no pressure, the monitoring chart is not good-looking .... I'm going to get hundreds of concurrent shell processes running and putting load on.
• Execute command

  Make an AJAX request, agent asynchronous processing, return to the library, and then use AJAX dynamic call database API display
  

• 650) this.width=650; "src=" http://s3.51cto.com/wyfs02/M00/6F/00/wKioL1WPaBmwynchAAKYmIduKQg139.jpg "style=" float: none; "title=" 10.jpg "alt=" Wkiol1wpabmwynchaakymidukqg139.jpg "/>

Summary:

This architecture is very flexible, arbitrary disassembly splicing, if small, can function integrated in a little, if large, can arbitrarily expand the bottleneck, the server All Daemon way.

These are the results of this period of study, a lot of excellent details can not be fully demonstrated, interested in contact reboot Operations Development Group (365534424)

• 
  

This article is from the "Reboot DevOps Development" blog, please be sure to keep this source http://opsdev.blog.51cto.com/2180875/1668681

Contributions from a group of students--high-performance extensible Python automation and operations framework