High-performance, extensible Python automated Operations Framework

bottlenecks encountered :

1, has been in the use of Python to write a variety of scripts, want to do automated operation and maintenance platform but powerless, have not seen the big operation and maintenance platform how to do,

2, the script of their own in the large scene is not reliable, whenever the discussion of some data based on SSH access to perform the operation of the way will be despised.

Enlightened :

Confused half a year can not find the direction, recently in the reboot system learning under, a lot of, a lot of doubts and difficult problems finally solved.

Thanks to the PC teacher for explaining the program's in-depth explanation of the use of the system [cpu\ memory utilization \ System characteristics] and how to define the network programming private protocol.

Several typical open source software source code of the network model analysis, how to really control multi-threading, how the Daemon fork, encapsulation socket non-blocking framework, how to develop a transport protocol.

works show:

• monitor and execute command flowchart

  650) this.width=650; "width=" 662 "height=" 845 "title=" high performance extensible Python automation Operations Framework [job] "id=" c1417402930465 "src="/http mmbiz.qpic.cn/mmbiz/mzws9obx0p6272sawbwfwpkszqwks6hfej3y0ndxualwvhbumowxpolmliaif7ljnzo6gbicwrietibmnpdl1v2g/ 640?tp=webp&wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px; Font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height: Inherit;vertical-align:middle;width:auto; "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

• software catalog [one server per minute, as needed]

• 650) this.width=650; "Width=" "height=" 331 "title=" high-performance extensible Python automation Operations Framework [job] "id=" c1417402930467 "src="/http mmbiz.qpic.cn/mmbiz/ mzws9obx0p6272sawbwfwpkszqwks6hf6jbq2vfb8rnqicdoiat3toog6ia3dmuoybbl3iofklyyoibxjiascqr1efq/640?tp=webp& Wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px;font-family:inherit; Font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height:inherit; Vertical-align:middle;width:auto; "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

• 650) this.width=650; "Width=" "height=" 144 "title=" high-performance extensible Python automation Operations Framework [job] "id=" c1417402930468 "src="/http Mmbiz.qpic.cn/mmbiz/mzws9obx0p6272sawbwfwpkszqwks6hfsg91iaw9fibicnzghiaomdme68scey8cgkxpdfq5rbszrbzjpbkwvonkuq /640?tp=webp&wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px; Font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height: Inherit;vertical-align:middle;width:auto; "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

• 650) this.width=650; "Width=" "height=" 521 "title=" high-performance extensible Python automation Operations Framework [job] "id=" c1417402930469 "src="/http mmbiz.qpic.cn/mmbiz/mzws9obx0p6272sawbwfwpkszqwks6hfgvqrtlvticsicar1ib9skclybfqzo9qcbmvol0wurkjkb9hd1whsibs06g /640?tp=webp&wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px; Font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height: Inherit;vertical-align:middle;width:auto; "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

• Agent of 4 threads, can arbitrarily expand arbitrary

  650) this.width=650; "width=" 770 "height=" 420 "title=" high performance extensible Python automation Operations Framework [job] "id=" c1417402930470 "src="/http mmbiz.qpic.cn/mmbiz/mzws9obx0p6272sawbwfwpkszqwks6hfzsuz5riasicc5trqjqqgx8tbj1ubzp5nfjibvqsxhtxeozdpl3dzrj1qw/ 640?tp=webp&wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px; Font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height: Inherit;vertical-align:middle;width:auto; "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

• Background request page and data interface

650) this.width=650; "width=" 1184 "height=" 752 "title=" high performance extensible Python automation Operations Framework [job] "id=" c1417402930471 "src="/http mmbiz.qpic.cn/mmbiz/mzws9obx0p6272sawbwfwpkszqwks6hfxy2jom9f0uu0sogk4cmxuhvih35rg2kj0wqd0mv63h8189e5y3lfxa/640 Tp=webp&wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px; Font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height: Inherit;vertical-align:middle;width:auto, "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

• page ajax Call Data interface

650) this.width=650; "Width=" 911 "height=" 399 "title=" high performance extensible Python automation Operations Framework [job] "id=" c1417402930472 "src="/http mmbiz.qpic.cn/mmbiz/mzws9obx0p6272sawbwfwpkszqwks6hf3dkmg4bvzmsteetyyieynkzdkjqeq5d1fhqrtm9liwndddtphojiew/640 Tp=webp&wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px; Font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height: Inherit;vertical-align:middle;width:auto, "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

• monitoring data plot

650) this.width=650; "Width=" 1124 "height=" 305 "title=" high performance extensible Python automation Operations Framework [job] "id=" c1417402930473 "src="/http mmbiz.qpic.cn/mmbiz/ mzws9obx0p6272sawbwfwpkszqwks6hfibml1tyf17qdlf0icocdmwaniceb98fnosibpweibtn7dktezwsiadkic7r0g/640?tp=webp& Wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px;font-family:inherit; Font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height:inherit; Vertical-align:middle;width:auto, "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>

Hey! The previous data, 6 servers at the same time running on a machine, no pressure, the monitoring chart is not good-looking .... I'm going to get hundreds of concurrent shell processes running and putting load on.

• Execute command

Make an AJAX request, agent asynchronous processing, return to the library, and then use AJAX dynamic call database API display

650) this.width=650; "Width=" "height=" 656 "title=" high-performance extensible Python automation Operations Framework [job] "id=" c1417402930474 "src="/http Mmbiz.qpic.cn/mmbiz/mzws9obx0p6272sawbwfwpkszqwks6hfexmicih2mdvweqrupqlwbniburtybmdlwhynpeuqepklibxm4sjiatjwow /640?tp=webp&wxfrom=5&wx_lazy=1 "style=" margin:5px 20px 20px 0px;padding:0px;height:auto;border:0px; Font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height: Inherit;vertical-align:middle;width:auto; "alt=" 640?tp=webp&wxfrom=5&wx_lazy=1 "/>Summary:

This architecture is very flexible, arbitrary disassembly splicing, if small, can function integrated in a little, if large, can arbitrarily expand the bottleneck, the server All Daemon way.

These are the results of this period of study, a lot of excellent details can not be fully displayed, interested in contact reboot Operations Development Group (365534424) Contact Group master Audition

High-performance, extensible Python automated Operations Framework