On Thu, Mar 10, 2011 at 04:00:09PM +0100, Oz Nahum Tiram wrote:
> ...
> http://octave.sourceforge.net/multicore/index.html
> http://octave.sourceforge.net/parallel/index.html
> http://octave.sourceforge.net/general/function/parcellfun.html
> http://octave.sourceforge.net/general/function/pararrayfun.html
> http://octave.sourceforge.net/openmpi_ext/index.html
> ...
> What I would like to to do, is to enable more than one compute server
> on each node. I.E, one than more octave process on each node using
> octave parallel. At the moment this is not possible because when the
> function server.m starts it looks for a pid lock file. Commands are
> sent to slave machines over TCP connections to port 12502, data is
> sent between machines over TCP connections to port 12501.

Can't comment much on openmpi, but as for the others:

parcellfun/pararrayfun are to be preferred over multicore (uses files
for communication) for using multiple nodes on a single machine IMO.

parallel contains two separate packages. The more specialized bw_...,
which you didn't mention, could make multiple connections to a single
host if you specifiy this host multiple times in the configuration. In
the general original part of the parallel package which you mention,
each server should also be able to receive multiple connections from
the master; for each connection from the master, a separate net of
connections for data exchange should be established within the set of
hosts given by the master. But the multiple processes you create in
this way on a single host won't be able to exchange data between each
other (can only exchange data with the master). An alternative here is
to use parcellfun/pararrayfun on a host to use all of its cores.

> The following lines in the file pserver.cc in the octave-parallel are
> responsible for the lock:
> ...
> So, after the long introduction, comes my question: 1. Is possible to
> remove this lock check ? 

This lock should only prevent to start the server multiple times on a
host computer. Once started, one server should be able to spawn
multiple processes, one for each connection request (see above).

>2. Will it be possible to make the master
> communicate with more than one slave on each host ? 

According to what is said above, it is already possible with parallel.

Finally, all these packages should not be discussed on the Octave
maintainers list, but on the list of Octave Forge, to which I respond.

Olaf

------------------------------------------------------------------------------
Colocation vs. Managed Hosting
A question and answer guide to determining the best fit
for your organization - today and in the future.
http://p.sf.net/sfu/internap-sfd2d
_______________________________________________
Octave-dev mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/octave-dev

Reply via email to