Parallel python--A simple distributed computing system

How to build a high-speed distributed computing platform? Parallel python for this purpose.

Parallel python (http://www.parallelpython.com/content/view/15/30/#QUICKCLUSTERS) is an open source module for distributed computing in Python. You can distribute the calculated pressure to multiple computers on a multi-core CPU or cluster. It is convenient to build a self-organizing distributed computing platform in the network.

Executes the server program on different nodes and proactively discovers the node that executes the server. Commands such as the following:

Node-1>./ppserver.py-a

Node-2>./ppserver.py-a

Node-3>./ppserver.py-a

Client

Import pp

Ppservers= ("*",) #自己主动发现模式

Job_server = pp. Server (Ppservers=ppservers)

Submit a running task

F1 = Job_server.submit (func1, ARGS1, DEPFUNCS1, modules1)

F2 = Job_server.submit (func1, ARGS2, DEPFUNCS1, modules1)

F3 = Job_server.submit (Func2, ARGS3, DEPFUNCS2, Modules2)

Search results

R1 = F1 ()

r2 = F2 ()

R3 = F3 ()

Copyright notice: This article blog original articles, blogs, without consent, may not be reproduced.

Parallel python--A simple distributed computing system