You don't need a cluster manager to use MPI with Julia. You can start the Julia processes in the MPI-usual way via "aprun julia myproc". In the Julia code, you can then use MPI to determine the workers' rank etc.
I have written a semi-usable set of communication primitives that work in this environment (@rexec, @par, etc.; names are different from standard Julia) <https://bitbucket.org/eschnett/funhpc.jl>, but I haven't measured or improved performance for this yet. -erik > On Feb 5, 2015, at 8:53 , Patrick Sanan <patrick.sa...@gmail.com> wrote: > > Hi Joshua - > > Did you continue working with this idea? I'd also like to experiment using > Julia in the Cray environment (using aprun etc). > > Best, > Patrick > > On Friday, August 15, 2014 at 6:25:35 AM UTC+2, Joshua Job wrote: > Hello all, > > I recently acquired an account under a project at ORNL's Titan supercomputer, > and had hoped to deploy some Julia codes I had written and used on my > University's HPC cluster but I'm having some trouble. Titan only allows one > to start processes on other computers via the "aprun" command, which is > basically the same as mpirun. You can have processes communicate, but only > via MPI (no sshing into compute nodes allowed). > > I know there is an MPI.jl package available and a ClusterManagers.jl package > available. Does anyone have any idea how much work would be involved in > trying to create a cluster manager that passes messages between workers via > MPI rather than ssh? > > Alternatively, I primarily use pmap for parallel computation, so I may be > able to get by with a wrapper script which will first compute which core will > do what task in the pmap-like operation and then create a configuration file > that all the julia workers can see what job they should do given their MPI > rank from MPI.jl. That might work, but it isn't as clean as the real pmap. > > Thanks in advance for any guidance y'all might be able to give! > -Josh. -- Erik Schnetter <schnet...@gmail.com> http://www.perimeterinstitute.ca/personal/eschnetter/ My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from https://sks-keyservers.net.
signature.asc
Description: Message signed with OpenPGP using GPGMail
