Re: [OMPI users] srun and openmpi

2011-01-25 Thread Michael Di Domenico
Yes, i am setting the config correcty. Our IB machines seem to run just fine so far using srun and openmpi v1.5. As another data point, we enabled mpi-threads in Openmpi and that also seems to trigger the Srun/TCP behavior, but on the IB fabric. Running the program within an salloc rather the st

Re: [OMPI users] openmpi's mpi_comm_spawn integrated with sge?

2011-01-25 Thread Reuti
Am 25.01.2011 um 20:10 schrieb Will Glover: > Thanks for your response, Reuti. Actually I had seen you mention the SGE > mailing list in response to a similar question but I can't for the life of me > find that list :( The list was removed with the shutdown of the open source site by Oracle,

Re: [OMPI users] srun and openmpi

2011-01-25 Thread Nathan Hjelm
We are seeing the similar problem with our infiniband machines. After some investigation I discovered that we were not setting our slurm environment correctly (ref: https://computing.llnl.gov/linux/slurm/mpi_guide.html#open_mpi). Are you setting the ports in your slurm.conf and executing srun

Re: [OMPI users] openmpi's mpi_comm_spawn integrated with sge?

2011-01-25 Thread Will Glover
Thanks for your response, Reuti. Actually I had seen you mention the SGE mailing list in response to a similar question but I can't for the life of me find that list :( As for using the background queue, just to clarify - is the idea to submit my parallel job on a regular queue with 100 proces

Re: [OMPI users] srun and openmpi

2011-01-25 Thread Michael Di Domenico
Thanks. We're only seeing it on machines with Ethernet only as the interconnect. fortunately for us that only equates to one small machine, but it's still annoying. unfortunately, i don't have enough knowledge to dive into the code to help fix, but i can certainly help test On Mon, Jan 24, 2011

Re: [OMPI users] openmpi's mpi_comm_spawn integrated with sge?

2011-01-25 Thread Reuti
Am 25.01.2011 um 12:32 schrieb Terry Dontje: > On 01/25/2011 02:17 AM, Will Glover wrote: >> Hi all, >> I tried a google/mailing list search for this but came up with nothing, so >> here goes: >> >> Is there any level of automation between open mpi's dynamic process >> management and the SGE qu

Re: [OMPI users] openmpi's mpi_comm_spawn integrated with sge?

2011-01-25 Thread Terry Dontje
On 01/25/2011 02:17 AM, Will Glover wrote: Hi all, I tried a google/mailing list search for this but came up with nothing, so here goes: Is there any level of automation between open mpi's dynamic process management and the SGE queue manager? In particular, can I make a call to mpi_comm_spawn

[OMPI users] openmpi's mpi_comm_spawn integrated with sge?

2011-01-25 Thread Will Glover
Hi all, I tried a google/mailing list search for this but came up with nothing, so here goes: Is there any level of automation between open mpi's dynamic process management and the SGE queue manager? In particular, can I make a call to mpi_comm_spawn and have SGE dynamically increase the numb

[OMPI users] Serial Rapid IO ?

2011-01-25 Thread Mohamed Husain A.K
Dear all , Is it possible to configure the cluster communication on serial rapid io ? kindly help Mohamed Husain > > > ___ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users >