Parallel Python-a simple distributed computing system

Parallel Python-a simple distributed computing system

How to build a fast distributed computing platform? Parallel python provides a simple way to achieve this goal.

Parallel Python (http://www.parallelpython.com/content/view/15/30/#QUICKCLUSTERS) is an open source module for Python distributed computing, which can distribute the computing pressure to multiple computers with multi-core CPUs or clusters, it is very convenient to build a self-organized distributed computing platform in the intranet.

Run the server program on different nodes and automatically discover the nodes running the server. The command is as follows:

Node-1>./ppserver. py-

Node-2>./ppserver. py-

Node-3>./ppserver. py-

Client

Import pp

Ppservers = ("*",) # automatic discovery Mode

Job_server = pp. Server (ppservers = ppservers)

Submit the task to be executed

F1 = job_server.submit (func1, args1, depfuncs1, modules1)

F2 = job_server.submit (func1, args2, depfuncs1, modules1)

F3 = job_server.submit (func2, args3, depfuncs2, modules2)

Search results

R1 = f1 ()

R2 = f2 ()

R3 = f3 ()