M.-A. Lemburg wrote:
The API of the processing module does look simple and nice, but
parallel processing is a minefield - esp. when it comes to handling
error situations (e.g. a worker failing, network going down, fail-over,
etc.).
What I'm missing with the processing module is a way to spawn processes
on clusters (rather than just on a single machine).
Perhaps one-size-fits-all isn't the right approach
here.
I think there's room for more than one module -- a
simple one for people who just want to spawn some
extra processes on the same CPU to take advantage
of multiple cores, and a fancier one (maybe based
on MPI) for people who want grid-computing style
distribution with error handling, fault tolerance,
etc.
(I didn't set out to justify that paragraph,
btw -- it just happened!)
--
Greg
_______________________________________________
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe:
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
