Re: [OMPI users] unable to open osc pt2pt

[de Almeida, Valmor F.]

I don't know how to access the svn repository.

svn checkout http://mpi4py.scipy.org/mpi4py/browser/mpi4py/trunk mpi4py
svn: PROPFIND request failed on '/mpi4py/browser/mpi4py/trunk'
svn: PROPFIND of '/mpi4py/browser/mpi4py/trunk': 200 Ok
(http://mpi4py.scipy.org)

Also signed up for the mpi4py users list; took many days to get a reply
and when I confirmed the subscription e-mail, it bounced back; maybe a
temporary problem?...

Thanks for any help.

--
Valmor

> -Original Message-
> From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org]
On
> Behalf Of Brian Granger
> Sent: Monday, December 17, 2007 10:47 AM
> To: Open MPI Users
> Subject: Re: [OMPI users] unable to open osc pt2pt
> 
> This should be fixed in the subversion trunk of mpi4py.  Can you do an
> update to that version and retry.  If it still doesn't work, post to
> the mpi4py list and we will see what we can do.
> 
> Brian
> 
> On Dec 17, 2007 8:25 AM, de Almeida, Valmor F. 
> wrote:
> >
> > Hello,
> >
> > I am getting these messages (below) when running mpi4py python
codes.
> > Always one message per mpi process. The codes seem to run correctly.
Any
> > ideas why this is happening and how to avoid it?
> >
> > Thanks,
> >
> > --
> > Valmor de Almeida
> >
> > >mpirun -np 2 python helloworld.py
> > [xeon0:05998] mca: base: component_find: unable to open osc pt2pt:
file
> > not found (ignored)
> > [xeon0:05999] mca: base: component_find: unable to open osc pt2pt:
file
> > not found (ignored)
> > Hello, World!! I am process 0 of 2 on xeon0.
> > Hello, World!! I am process 1 of 2 on xeon0.
> >
> >
> >
> > ___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
> >
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users

Re: [OMPI users] Torque and OpenMPI 1.2

[Adams, Brian M]

Ralph,

Thanks for the clarification as I'm dealing with workarounds for this at
Sandia as well...

I might have missed this earlier in the dialog, but is this capability
in the SVN trunk right now, or still on the TODO list?

Brian

Brian M. Adams, PhD (bria...@sandia.gov)
Optimization and Uncertainty Estimation
Sandia National Laboratories
P.O. Box 5800, Mail Stop 1318
Albuquerque, NM 87185-1318
Voice: 505-284-8845, FAX: 505-284-2518

> -Original Message-
> From: users-boun...@open-mpi.org 
> [mailto:users-boun...@open-mpi.org] On Behalf Of Ralph H Castain
> Sent: Wednesday, December 19, 2007 2:35 PM
> To: Open MPI Users ; pat.o'bry...@exxonmobil.com
> Cc: Castain, Ralph H. (LANL)
> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> 
> 
> Open MPI 1.3 will support use of the hostfile and the tm 
> launcher simultaneously. It will work slightly differently, 
> though, with respect to the hostfile:
> 
> 1. PBS_NODEFILE will be read to obtain a complete list of 
> what has been allocated to us
> 
> 2. you will be allowed to provide a hostfile for each 
> app_context as a separate entry to define the hosts to be 
> used for that specific app_context.
> The hosts in your hostfile, however, must be included in the 
> PBS_NODEFILE.
> 
> Basically, the hostfile argument will serve as a filter to 
> the hosts provided via PBS_NODEFILE. We will use the TM 
> launcher (unless, of course, you tell us to do otherwise), so 
> the issues I mentioned before will go away.
> 
> There will be a FAQ entry describing the revised hostfile 
> behavior in some detail. We think the change will help 
> rationalize the behavior so it is more consistent across all 
> the different use-cases people have invented. ;-)
> 
> Hope that helps
> Ralph
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 
> 

Re: [OMPI users] Torque and OpenMPI 1.2

[Ralph H Castain]

Open MPI 1.3 will support use of the hostfile and the tm launcher
simultaneously. It will work slightly differently, though, with respect to
the hostfile:

1. PBS_NODEFILE will be read to obtain a complete list of what has been
allocated to us

2. you will be allowed to provide a hostfile for each app_context as a
separate entry to define the hosts to be used for that specific app_context.
The hosts in your hostfile, however, must be included in the PBS_NODEFILE.

Basically, the hostfile argument will serve as a filter to the hosts
provided via PBS_NODEFILE. We will use the TM launcher (unless, of course,
you tell us to do otherwise), so the issues I mentioned before will go away.

There will be a FAQ entry describing the revised hostfile behavior in some
detail. We think the change will help rationalize the behavior so it is more
consistent across all the different use-cases people have invented. ;-)

Hope that helps
Ralph


On 12/19/07 2:05 PM, "pat.o'bry...@exxonmobil.com"
 wrote:

> Ralph,
> Thanks for the information. I am assuming OpenMPI 1.3 will support
> the
> "-hostfile" without the extra parms. Will 1.3 also carry the same
> restrictions you list below?
>   Pat
> 
> J.W. (Pat) O'Bryant,Jr.
> Business Line Infrastructure
> Technical Systems, HPC
> Office: 713-431-7022
> 
> 
> 
> 
>  Ralph H
>  Castain
>   
>  To
>  Sent by: "Open MPI Users
>  users-bounces@   "
>  open-
> mpi.org   cc
>   Ralph H Castain 
>  
> Subject
>  12/19/07 10:10   Re: [OMPI users] Torque and
> OpenMPI
>  AM   1.2
> 
> 
>  Please respond
>to
>  Open MPI Users
>    i.org>
> 
> 
> 
> 
> 
> 
> 
> 
> Just to be clear: what this does is tell Open MPI to launch using the
> SSH
> launcher. This will work okay, but means that Torque doesn't know
> about the
> children and cannot monitor them. It also won't work on clusters (such
> as
> the ones we have here) that do not allow you to ssh procs onto the
> backend
> nodes.
> 
> If you are going this route, you actually don't need the --with-tm
> configure
> option. Your command line basically tells the system to ignore anything
> associated with tm anyway - you are operating just as if you were in an
> ssh-only cluster.
> 
> If it works for you, that is great - just be aware of the limitations
> and
> disclaimers. I would only suggest it be used as a temporary workaround
> as
> opposed to a general practice.
> 
> Ralph
> 
>> 
>>> From: "Caird, Andrew J" 
>>> Date: December 19, 2007 9:40:27 AM EST
>>> To: "Open MPI Users" 
>>> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
>>> Reply-To: Open MPI Users 
>>> 
>>> 
>>> Glad to hear that worked for you.
>>> 
>>> Full credit goes to Brock Palen who told me about this.  It turns
>>> out we also have a user who wanted to do that.  And meta-credit goes
>>> to the OMPI developers for making a consistent and flexible set of
>>> MPI tools and libraries.
>>> 
>>> --andy
>>> 
>>> 
 -Original Message-
 From: users-boun...@open-mpi.org
 [mailto:users-boun...@open-mpi.org] On Behalf Of
 pat.o'bry...@exxonmobil.com
 Sent: Wednesday, December 19, 2007 9:37 AM
 To: Open MPI Users
 Subject: Re: [OMPI users] Torque and OpenMPI 1.2
 
 Andrew,
That worked like a champ. Now my users can have it both
 ways. For the
 record, my control statements looked like the following:
 
 /opt/openmpi-1.2.4/bin/mpirun -mca pls ^tm -np $NP -hostfile
 $PBS_NODEFILE
 $my_binary_path
 
 My job works just fine and reports no errors. This version of
 OpenMPI was
 built with "--with-tm=/usr/local/pbs".
 
 Thanks for your help,
  Pat
 
 
 J.W. (Pat) O'Bryant,Jr.
 Business Line Infrastructure
 Technical Systems, HPC
 Office: 713-431-7022
 
 
 
 
 
"Caird, Andrew
 
J"
 
 "Open MPI Users"
 
Sent by: 
 
users-bounces@
 cc
open-mpi.org
 
 
Subject
 Re: [OMPI users] Torque
 and OpenMPI
12/19/07 07:59   1.2
 
AM
 
 
 
 
 
Please respond
 
  to
 
Open MPI Users

Re: [OMPI users] Torque and OpenMPI 1.2

[pat . o'bryant]

Ralph,
Thanks for the information. I am assuming OpenMPI 1.3 will support the
"-hostfile" without the extra parms. Will 1.3 also carry the same
restrictions you list below?
  Pat

J.W. (Pat) O'Bryant,Jr.
Business Line Infrastructure
Technical Systems, HPC
Office: 713-431-7022




 Ralph H   
 Castain   
  To 
 Sent by: "Open MPI Users  
 users-bounces@   "
 open-mpi.org   cc 
  Ralph H Castain    
   Subject 
 12/19/07 10:10   Re: [OMPI users] Torque and OpenMPI  
 AM   1.2  


 Please respond
   to  
 Open MPI Users
 








Just to be clear: what this does is tell Open MPI to launch using the SSH
launcher. This will work okay, but means that Torque doesn't know about the
children and cannot monitor them. It also won't work on clusters (such as
the ones we have here) that do not allow you to ssh procs onto the backend
nodes.

If you are going this route, you actually don't need the --with-tm
configure
option. Your command line basically tells the system to ignore anything
associated with tm anyway - you are operating just as if you were in an
ssh-only cluster.

If it works for you, that is great - just be aware of the limitations and
disclaimers. I would only suggest it be used as a temporary workaround as
opposed to a general practice.

Ralph

>
>> From: "Caird, Andrew J" 
>> Date: December 19, 2007 9:40:27 AM EST
>> To: "Open MPI Users" 
>> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
>> Reply-To: Open MPI Users 
>>
>>
>> Glad to hear that worked for you.
>>
>> Full credit goes to Brock Palen who told me about this.  It turns
>> out we also have a user who wanted to do that.  And meta-credit goes
>> to the OMPI developers for making a consistent and flexible set of
>> MPI tools and libraries.
>>
>> --andy
>>
>>
>>> -Original Message-
>>> From: users-boun...@open-mpi.org
>>> [mailto:users-boun...@open-mpi.org] On Behalf Of
>>> pat.o'bry...@exxonmobil.com
>>> Sent: Wednesday, December 19, 2007 9:37 AM
>>> To: Open MPI Users
>>> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
>>>
>>> Andrew,
>>> That worked like a champ. Now my users can have it both
>>> ways. For the
>>> record, my control statements looked like the following:
>>>
>>> /opt/openmpi-1.2.4/bin/mpirun -mca pls ^tm -np $NP -hostfile
>>> $PBS_NODEFILE
>>> $my_binary_path
>>>
>>> My job works just fine and reports no errors. This version of
>>> OpenMPI was
>>> built with "--with-tm=/usr/local/pbs".
>>>
>>>  Thanks for your help,
>>>   Pat
>>>
>>>
>>> J.W. (Pat) O'Bryant,Jr.
>>> Business Line Infrastructure
>>> Technical Systems, HPC
>>> Office: 713-431-7022
>>>
>>>
>>>
>>>
>>>
>>> "Caird, Andrew
>>>
>>> J"
>>>
>>> >>  To
>>> edu> "Open MPI Users"
>>>
>>> Sent by: 
>>>
>>> users-bounces@
>>>  cc
>>> open-mpi.org
>>> 
>>>
>>> Subject
>>>  Re: [OMPI users] Torque
>>> and OpenMPI
>>> 12/19/07 07:59   1.2
>>>
>>> AM
>>>
>>>
>>>
>>>
>>>
>>> Please respond
>>>
>>>   to
>>>
>>> Open MPI Users
>>>
>>> >>
>>> i.org>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> oops, I meant -mca, not -mcs
>>>
>>>
 -Original Message-
 From: users-boun...@open-mpi.org
 [mailto:users-boun...@open-mpi.org] On Behalf Of Caird, Andrew J
 Sent: Wednesday, December 19, 2007 8:57 AM
 To: Open MPI Users
 Cc: users-boun...@open-mpi.org
 Subject: Re: [OMPI users] Torque and OpenMPI 1.2

 Does OMPI built with TM but run with:
   -mcs pls ^tm

 give the same effect?

 --andy


> -Original Message-
> From: users-boun...@open-mpi.org
> [mailto:users-boun...@open-mpi.org] On Behalf Of
> pat.o'bry...@exxonmobil.com
> Sent: Wednesday, 

[OMPI users] Fwd: [all-osl-users] Outage of the OSL services

[Jeff Squyres]

FYI -- all of Open MPI's electronic resources will be offline for half  
of Dec 26 for some scheduled maintenance.  Please see below for details.



Begin forwarded message:


From: DongInn Kim 
Date: December 19, 2007 12:13:48 PM EST
To: all-osl-us...@osl.iu.edu
Subject: [all-osl-users] Outage of the OSL services

Hi,

There will be the outage of the OSL systems on December 26th, 2007  
because of the power outage in the Computer Science Department  
machine room at Indiana University.


The detail information about the power outage is following.
http://www.cs.indiana.edu/Facilities/notices/Downtime.html

The outage of the OSL systems is expected on Dec 26th, 2007:
- 4:00am-9:00am Pacific US time
- 5:00am-10:00am Mountain US time
- 6:00am-11:00am Central US time
- 7:00am-12:00pm Eastern US time
- 12:00pm-5:00pm GMT

Following are the unavailable services the during the reboot time.
- Web services to any OSL-hosted domain
 (e.g., www.osl.iu.edu, www.lam-mpi.org, www.open-mpi.org,  
*.boost.org, ...)
 Note that this includes mailman services and mail archive  
service(hypermail)

 Note that this includes bug tracking services
 Note that this includes webmail
- Incoming e-mail to any OSL-hosted domain
 (e.g., osl.iu.edu, lam-mpi.org, open-mpi.org, *.boost.org, ...)
 Note that this includes *ALL* mailing lists!
- IMAP/SSL services
- SMTP/auth services (e-mail relaying through milliways)
- Subversion services
- Trac services
- NFS services

Please let me know if you have any questions or concerns about this  
outage.


Regards,

--
- DongInn



--
Jeff Squyres
Cisco Systems

Re: [OMPI users] new to MPI+infiniband

[Brian Budge]

Wow, I'm amazed... it just works "out-of-the-box" configured with
with-openib.  I guess the new kernel supplies everything I need.

Thanks a bunch for the clues.

  Brian

On Dec 19, 2007 5:55 AM, Jeff Squyres  wrote:

> In general, you need a functioning IB subsystem on your machines for
> OMPI to build for and use IB.  This includes both the set of kernel
> drivers and the userspace libraries.  In particular, Open MPI v1.2
> uses the "ibverbs" library.  If OMPI can find the ibverbs library and
> headers during its configure phase, it will build IB support and try
> to use it at run time.
>
> You can see if OMPI finds what it needs in the stdout of configure --
> search for the string "openib" and see where it configures the BTL
> openib component.  If it ends with a message indicating that it will
> compile the openib BTL component, then you're good.  If not, you'll
> see some specific tests that fail that indicate why it won't include
> that support (e.g., can't find the right header files or somesuch).
>
>
> On Dec 19, 2007, at 8:49 AM, pat.o'bry...@exxonmobil.com wrote:
>
> > Brian,
> >Here is how I do it:
> >
> > ./configure --prefix /opt/openmpi-1.2.4 --with-openib=/usr/local/
> > ofed \
> > --without-tm CC=icc CXX=icpc F77=ifort FC=ifort \
> > --with-threads=posix --enable-mpi-threads
> >
> >
> > J.W. (Pat) O'Bryant,Jr.
> > Business Line Infrastructure
> > Technical Systems, HPC
> > Office: 713-431-7022
> >
> >
> >
> >
> > "Brian Budge"
> >  >
> > mail.com>  To
> > Sent by: "Open MPI Users"
> > users-bounces@   
> > open-
> > mpi.org   cc
> >
> >
> > Subject
> > 12/19/07 12:35   [OMPI users] new to MPI
> > +infiniband
> > AM
> >
> >
> > Please respond
> >   to
> > Open MPI Users
> >  > i.org>
> >
> >
> >
> >
> >
> >
> >
> >
> > Hi all -
> >
> > I have been using OpenMPI for quite a while now, and its working out
> > great.
> > I was looking at the FAQ and trying to figure out how to configure
> > OpenMPI
> > with infiniband.  It shows how to enable IB pointing to the OFED
> > directory.
> >
> >
> > I have infiniband built into the kernel, along with IP over IB and
> > with the
> > Mellanox drivers.  What would I still need to install, and how would I
> > configure OpenMPI to work with this?
> >
> > Thanks,
> >  Brian___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
> >
> > ___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>
> --
> Jeff Squyres
> Cisco Systems
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>

Re: [OMPI users] error with Vprotocol pessimist

[Thomas Ropars]

Hi,

I have the same error message when fault tolerance is activated.
I'm using gcc version 4.1.3, with Ubuntu 7.10 (i686) (kernel 
2.6.22-14-generic)


Thomas

Aurelien Bouteiller wrote:
If you want to use the pessimist message logging you have to use the "- 
mca vprotocol pessimist" flag on your command line. This should work  
despite the bug because if I understand correctly, the issue you  
experience should occur only when fault tolerance is disabled.
I have troubles to reproduce the particular bug you are experiencing.  
What compiler and what architecture are you using ?


Aurelien
Le 13 déc. 07 à 07:58, Thomas Ropars a écrit :

  

I still have the same error after update (r16951).

I have the lib/openmpi/mca_pml_v.so file in my builld and the command
line I use is: mpirun -np 4 my_application

Thomas


Aurelien Bouteiller wrote:


I could reproduce and fix the bug. It will be corrected in trunk as
soon as the svn is online again. Thanks for reporting the problem.

Aurelien

Le 11 déc. 07 à 15:02, Aurelien Bouteiller a écrit :


  

I cannot reproduce the error. Please make sure you have the lib/
openmpi/mca_pml_v.so file in your build. If you don't, maybe you
forgot to run autogen.sh at the root of the trunk when you
removed .ompi_ignore.

If this does not fix the problem, please let me know your command  
line

options to mpirun.

Aurelien

Le 11 déc. 07 à 14:36, Aurelien Bouteiller a écrit :




Mmm, I'll investigate this today.

Aurelien
Le 11 déc. 07 à 08:46, Thomas Ropars a écrit :


  

Hi,

I've tried to test the message logging component vprotocol
pessimist.
(svn checkout revision 16926)
When I run an mpi application, I get the following error :

mca: base: component_find: unable to open vprotocol pessimist:
/local/openmpi/lib/openmpi/mca_vprotocol_pessimist.so: undefined
symbol:
pml_v_output (ignored)


Regards

Thomas
___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users



--
Dr. Aurelien Bouteiller, Sr. Research Associate
Innovative Computing Laboratory - MPI group
+1 865 974 6321
1122 Volunteer Boulevard
Claxton Education Building Suite 350
Knoxville, TN 37996


___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users

  

___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users



___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users

  

___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users




___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users
  

Re: [OMPI users] Theoretical Differences: Cluster Computing, Distributed Computing, Grid Computing

[Amit Kumar Saha]

On 12/19/07, Jeff Squyres  wrote:
> On Dec 19, 2007, at 11:33 AM, Amit Kumar Saha wrote:
>
> > This probably is the same as saying that : In Distributed computing,
> > the member nodes are *not* dedicated machines solely for executing the
> > specific HPC task, where as in a Cluster we have a dedicated set of
> > nodes, specifically working on a particular task.
>
>
> Those are common models, yes.  But probably not the only ones (notice
> how I used "usually" liberally in my definitions :-) ).
>
> Given the differences between Aurelien's answers and mine, I think the
> community really only has general ideas about what exactly those terms
> mean.

Yes, I shall accept that, since time and again I have thought about
this terms- I have always had to end up getting confused, searching
for the _exact_, clear-cut difference.

Thanks again!
Amit
-- 
Amit Kumar Saha
*NetBeans Community
Docs Coordinator*
http://amitsaha.in.googlepages.com
http://amitksaha.blogspot.com

Re: [OMPI users] Theoretical Differences: Cluster Computing, Distributed Computing, Grid Computing

[Jeff Squyres]

On Dec 19, 2007, at 11:33 AM, Amit Kumar Saha wrote:


This probably is the same as saying that : In Distributed computing,
the member nodes are *not* dedicated machines solely for executing the
specific HPC task, where as in a Cluster we have a dedicated set of
nodes, specifically working on a particular task.



Those are common models, yes.  But probably not the only ones (notice  
how I used "usually" liberally in my definitions :-) ).


Given the differences between Aurelien's answers and mine, I think the  
community really only has general ideas about what exactly those terms  
mean.


--
Jeff Squyres
Cisco Systems

Re: [OMPI users] Theoretical Differences: Cluster Computing, Distributed Computing, Grid Computing

[Amit Kumar Saha]

On 12/19/07, Aurelien Bouteiller  wrote:
> I have quite different definitions than Jeff.
>
> Distributed computing is encompassing all the "parallel computing"
> models, including clusters, grids, master-slave, shared memory...
> Everything that basically implies using several collaborating
> processes to solve a problem (whatever collaborating means, network,
> shared memory, RPC, data dependencies... ).
>
> Cluster computing simply refers simply to computations that occurs on
> a cluster type machine. A cluster is -usually- a distributed memory
> computer based on commodity hardware (but counter examples exist).  It
> may include commodity network (like giga ethernet) or more specific
> nics (like myrinet, infiniband, quadrics and so on). As said Jeff,
> usually the best way to use such a machine is to have a kind of
> tightly coupled application.
>
> Grid computing refers to gathering several clusters (and sometimes
> large databases and scientific instruments like telescopes that
> generate data) and use them altogether. Compared to a cluster or a
> supercomputer, this introduces several issues related to password
> administration, user domains, firewall bypass, several different
> scheduler collaborating, and quite slow network between the sites.

I understand that a major difference between Distributed Computing and
Grid Computing is that whereas we *usually* have a set of trusted
nodes in the former, in the latter case, we generally have
geographically dispersed computers which use a separate authentication
mechanism to come together and form a Grid.


Please correct me if I am wrong

Thanks,
Amit
-- 
Amit Kumar Saha
Writer, Programmer, Researcher
http://amitsaha.in.googlepages.com
http://amitksaha.blogspot.com

Re: [OMPI users] Theoretical Differences: Cluster Computing, Distributed Computing, Grid Computing

[Amit Kumar Saha]

On 12/19/07, Jeff Squyres  wrote:
> It's a pretty hazy difference; I don't think there are formal
> definitions for each.
>
> Cluster computing *usually* (but not always) implies a bit more
> tightly coupled set of computing: the app communicates and coordinates
> between itself more than your standard manager/worker computation
> model.  Distributed computing *usually* focuses on the manager/worker
> model -- send some work to anyone who asks for it and then eventually
> get some results back from them (or not -- then you have to send the
> same work out to someone else).
>
> But you can certainly use the manager/worker model in cluster
> computing, too.  Not all cluster computing is tightly coupled.

This probably is the same as saying that : In Distributed computing,
the member nodes are *not* dedicated machines solely for executing the
specific HPC task, where as in a Cluster we have a dedicated set of
nodes, specifically working on a particular task.

Correct me, if I am wrong.

Thanks,
Amit

-- 
Amit Kumar Saha
Writer, Programmer, Researcher
http://amitsaha.in.googlepages.com
http://amitksaha.blogspot.com

Re: [OMPI users] Torque and OpenMPI 1.2

[Ralph H Castain]

Just to be clear: what this does is tell Open MPI to launch using the SSH
launcher. This will work okay, but means that Torque doesn't know about the
children and cannot monitor them. It also won't work on clusters (such as
the ones we have here) that do not allow you to ssh procs onto the backend
nodes.

If you are going this route, you actually don't need the --with-tm configure
option. Your command line basically tells the system to ignore anything
associated with tm anyway - you are operating just as if you were in an
ssh-only cluster.

If it works for you, that is great - just be aware of the limitations and
disclaimers. I would only suggest it be used as a temporary workaround as
opposed to a general practice.

Ralph

> 
>> From: "Caird, Andrew J" 
>> Date: December 19, 2007 9:40:27 AM EST
>> To: "Open MPI Users" 
>> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
>> Reply-To: Open MPI Users 
>> 
>> 
>> Glad to hear that worked for you.
>> 
>> Full credit goes to Brock Palen who told me about this.  It turns
>> out we also have a user who wanted to do that.  And meta-credit goes
>> to the OMPI developers for making a consistent and flexible set of
>> MPI tools and libraries.
>> 
>> --andy
>> 
>> 
>>> -Original Message-
>>> From: users-boun...@open-mpi.org
>>> [mailto:users-boun...@open-mpi.org] On Behalf Of
>>> pat.o'bry...@exxonmobil.com
>>> Sent: Wednesday, December 19, 2007 9:37 AM
>>> To: Open MPI Users
>>> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
>>> 
>>> Andrew,
>>> That worked like a champ. Now my users can have it both
>>> ways. For the
>>> record, my control statements looked like the following:
>>> 
>>> /opt/openmpi-1.2.4/bin/mpirun -mca pls ^tm -np $NP -hostfile
>>> $PBS_NODEFILE
>>> $my_binary_path
>>> 
>>> My job works just fine and reports no errors. This version of
>>> OpenMPI was
>>> built with "--with-tm=/usr/local/pbs".
>>> 
>>>  Thanks for your help,
>>>   Pat
>>> 
>>> 
>>> J.W. (Pat) O'Bryant,Jr.
>>> Business Line Infrastructure
>>> Technical Systems, HPC
>>> Office: 713-431-7022
>>> 
>>> 
>>> 
>>> 
>>> 
>>> "Caird, Andrew
>>> 
>>> J"
>>> 
>>> >>  To
>>> edu> "Open MPI Users"
>>> 
>>> Sent by: 
>>> 
>>> users-bounces@
>>>  cc
>>> open-mpi.org
>>> 
>>> 
>>> Subject
>>>  Re: [OMPI users] Torque
>>> and OpenMPI
>>> 12/19/07 07:59   1.2
>>> 
>>> AM
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Please respond
>>> 
>>>   to
>>> 
>>> Open MPI Users
>>> 
>>> >> 
>>> i.org>
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> oops, I meant -mca, not -mcs
>>> 
>>> 
 -Original Message-
 From: users-boun...@open-mpi.org
 [mailto:users-boun...@open-mpi.org] On Behalf Of Caird, Andrew J
 Sent: Wednesday, December 19, 2007 8:57 AM
 To: Open MPI Users
 Cc: users-boun...@open-mpi.org
 Subject: Re: [OMPI users] Torque and OpenMPI 1.2
 
 Does OMPI built with TM but run with:
   -mcs pls ^tm
 
 give the same effect?
 
 --andy
 
 
> -Original Message-
> From: users-boun...@open-mpi.org
> [mailto:users-boun...@open-mpi.org] On Behalf Of
> pat.o'bry...@exxonmobil.com
> Sent: Wednesday, December 19, 2007 8:47 AM
> To: Open MPI Users
> Cc: Open MPI Users; users-boun...@open-mpi.org
> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> 
> Terry,
>Your suggestion worked. So long as I specifically state
> "--without-tm",
> the OpenMPI 1.2.4 build allows the use of "-hostfile".
 Apparently, by
> default, OpenMPI 1.2.4 will incorporate Torque if it
 exists, so it is
> necessary to specifically request "no Torque support".  I
> used the normal
> Torque processes to submit the job and specified "-hostfile
> $PBS_NODEFILE".
> Everything worked.
>   Thanks for your help,
>Pat
> 
> J.W. (Pat) O'Bryant,Jr.
> Business Line Infrastructure
> Technical Systems, HPC
> Office: 713-431-7022
> 
> 
> 
> 
> 
> Terry
> 
> Frankcombe
> 
>   To
> .se> Open MPI Users
> 
> Sent by:
>  cc
> users-bounces@
> 
> open-mpi.org
> Subject
>  Re: [OMPI users] Torque
> and OpenMPI
>  1.2
> 
> 12/18/07 01:45
> 
> PM
> 

Re: [OMPI users] Torque and OpenMPI 1.2

[pat . o'bryant]

Andy,
I second the praise of the developers. The developers along with an
involved user community can lead to nothing but success.
  Pat


J.W. (Pat) O'Bryant,Jr.
Business Line Infrastructure
Technical Systems, HPC
Office: 713-431-7022




 "Caird, Andrew
 J"
  "Open MPI Users" 
 Sent by:  
 users-bounces@ cc 
 open-mpi.org  
   Subject 
  Re: [OMPI users] Torque and OpenMPI  
 12/19/07 08:40   1.2  
 AM


 Please respond
   to  
 Open MPI Users
 









Glad to hear that worked for you.

Full credit goes to Brock Palen who told me about this.  It turns out we
also have a user who wanted to do that.  And meta-credit goes to the OMPI
developers for making a consistent and flexible set of MPI tools and
libraries.

--andy


> -Original Message-
> From: users-boun...@open-mpi.org
> [mailto:users-boun...@open-mpi.org] On Behalf Of
> pat.o'bry...@exxonmobil.com
> Sent: Wednesday, December 19, 2007 9:37 AM
> To: Open MPI Users
> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
>
> Andrew,
>  That worked like a champ. Now my users can have it both
> ways. For the
> record, my control statements looked like the following:
>
> /opt/openmpi-1.2.4/bin/mpirun -mca pls ^tm -np $NP -hostfile
> $PBS_NODEFILE
> $my_binary_path
>
> My job works just fine and reports no errors. This version of
> OpenMPI was
> built with "--with-tm=/usr/local/pbs".
>
>   Thanks for your help,
>Pat
>
>
> J.W. (Pat) O'Bryant,Jr.
> Business Line Infrastructure
> Technical Systems, HPC
> Office: 713-431-7022
>
>
>
>
>
>  "Caird, Andrew
>
>  J"
>
>     To
>  edu> "Open MPI Users"
>
>  Sent by: 
>
>  users-bounces@
>   cc
>  open-mpi.org
> 
>
>  Subject
>   Re: [OMPI users] Torque
> and OpenMPI
>  12/19/07 07:59   1.2
>
>  AM
>
>
>
>
>
>  Please respond
>
>to
>
>  Open MPI Users
>
>  
>  i.org>
>
>
>
>
>
>
>
>
>
>
>
>
>
> oops, I meant -mca, not -mcs
>
>
> > -Original Message-
> > From: users-boun...@open-mpi.org
> > [mailto:users-boun...@open-mpi.org] On Behalf Of Caird, Andrew J
> > Sent: Wednesday, December 19, 2007 8:57 AM
> > To: Open MPI Users
> > Cc: users-boun...@open-mpi.org
> > Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> >
> > Does OMPI built with TM but run with:
> >-mcs pls ^tm
> >
> > give the same effect?
> >
> > --andy
> >
> >
> > > -Original Message-
> > > From: users-boun...@open-mpi.org
> > > [mailto:users-boun...@open-mpi.org] On Behalf Of
> > > pat.o'bry...@exxonmobil.com
> > > Sent: Wednesday, December 19, 2007 8:47 AM
> > > To: Open MPI Users
> > > Cc: Open MPI Users; users-boun...@open-mpi.org
> > > Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> > >
> > > Terry,
> > > Your suggestion worked. So long as I specifically state
> > > "--without-tm",
> > > the OpenMPI 1.2.4 build allows the use of "-hostfile".
> > Apparently, by
> > > default, OpenMPI 1.2.4 will incorporate Torque if it
> > exists, so it is
> > > necessary to specifically request "no Torque support".  I
> > > used the normal
> > > Torque processes to submit the job and specified "-hostfile
> > > $PBS_NODEFILE".
> > > Everything worked.
> > >Thanks for your help,
> > > Pat
> > >
> > > J.W. (Pat) O'Bryant,Jr.
> > > Business Line Infrastructure
> > > Technical Systems, HPC
> > > Office: 713-431-7022
> > >
> > >
> > >
> > >
> > >
> > >  Terry
> > >
> > >  Frankcombe
> > >
> > >   > >   To
> > >  .se> Open MPI Users
> > > 
> > >  Sent by:
> > >   cc
> > >  users-bounces@
> 

Re: [OMPI users] Torque and OpenMPI 1.2

[Caird, Andrew J]

Glad to hear that worked for you.

Full credit goes to Brock Palen who told me about this.  It turns out we also 
have a user who wanted to do that.  And meta-credit goes to the OMPI developers 
for making a consistent and flexible set of MPI tools and libraries.

--andy


> -Original Message-
> From: users-boun...@open-mpi.org 
> [mailto:users-boun...@open-mpi.org] On Behalf Of 
> pat.o'bry...@exxonmobil.com
> Sent: Wednesday, December 19, 2007 9:37 AM
> To: Open MPI Users
> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> 
> Andrew,
>  That worked like a champ. Now my users can have it both 
> ways. For the
> record, my control statements looked like the following:
> 
> /opt/openmpi-1.2.4/bin/mpirun -mca pls ^tm -np $NP -hostfile 
> $PBS_NODEFILE
> $my_binary_path
> 
> My job works just fine and reports no errors. This version of 
> OpenMPI was
> built with "--with-tm=/usr/local/pbs".
> 
>   Thanks for your help,
>Pat
> 
> 
> J.W. (Pat) O'Bryant,Jr.
> Business Line Infrastructure
> Technical Systems, HPC
> Office: 713-431-7022
> 
> 
> 
>   
>  
>  "Caird, Andrew   
>  
>  J"   
>  
>     To 
>  edu> "Open MPI Users"
>  
>  Sent by: 
>  
>  users-bounces@   
>   cc 
>  open-mpi.org 
>  
>   
>  Subject 
>   Re: [OMPI users] Torque 
> and OpenMPI  
>  12/19/07 07:59   1.2 
>  
>  AM   
>  
>   
>  
>   
>  
>  Please respond   
>  
>to 
>  
>  Open MPI Users   
>  
>    
>  i.org>   
>  
>   
>  
>   
>  
>   
>  
>   
>  
> 
> 
> 
> 
> oops, I meant -mca, not -mcs
> 
> 
> > -Original Message-
> > From: users-boun...@open-mpi.org
> > [mailto:users-boun...@open-mpi.org] On Behalf Of Caird, Andrew J
> > Sent: Wednesday, December 19, 2007 8:57 AM
> > To: Open MPI Users
> > Cc: users-boun...@open-mpi.org
> > Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> >
> > Does OMPI built with TM but run with:
> >-mcs pls ^tm
> >
> > give the same effect?
> >
> > --andy
> >
> >
> > > -Original Message-
> > > From: users-boun...@open-mpi.org
> > > [mailto:users-boun...@open-mpi.org] On Behalf Of
> > > pat.o'bry...@exxonmobil.com
> > > Sent: Wednesday, December 19, 2007 8:47 AM
> > > To: Open MPI Users
> > > Cc: Open MPI Users; users-boun...@open-mpi.org
> > > Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> > >
> > > Terry,
> > > Your suggestion worked. So long as I specifically state
> > > "--without-tm",
> > > the OpenMPI 1.2.4 build allows the use of "-hostfile".
> > Apparently, by
> > > default, OpenMPI 1.2.4 will incorporate Torque if it
> > exists, so it is
> > > necessary to specifically request "no Torque support".  I
> > > used the normal
> > > Torque processes to submit the job and specified "-hostfile
> > > $PBS_NODEFILE".
> > > Everything worked.
> > >Thanks for your help,
> > > Pat
> > >
> > > J.W. (Pat) O'Bryant,Jr.
> > > Business Line Infrastructure
> > > Technical Systems, HPC
> > > Office: 713-431-7022
> > >
> > >
> > >
> > >
> > >
> > >  Terry
> > >
> > >  Frankcombe
> > >
> > >   > >   To
> > >  .se> Open MPI Users
> > > 
> > >  Sent by:
> > >   cc
> > >  users-bounces@
> > >
> > >  open-mpi.org
> > >  Subject
> > >   Re: [OMPI users] Torque
> > > and OpenMPI
> > >   1.2
> > >
> > >  12/18/07 01:45
> > >
> > >  PM
> 

Re: [OMPI users] Torque and OpenMPI 1.2

[pat . o'bryant]

Andrew,
 That worked like a champ. Now my users can have it both ways. For the
record, my control statements looked like the following:

/opt/openmpi-1.2.4/bin/mpirun -mca pls ^tm -np $NP -hostfile $PBS_NODEFILE
$my_binary_path

My job works just fine and reports no errors. This version of OpenMPI was
built with "--with-tm=/usr/local/pbs".

  Thanks for your help,
   Pat


J.W. (Pat) O'Bryant,Jr.
Business Line Infrastructure
Technical Systems, HPC
Office: 713-431-7022




 "Caird, Andrew
 J"
  "Open MPI Users" 
 Sent by:  
 users-bounces@ cc 
 open-mpi.org  
   Subject 
  Re: [OMPI users] Torque and OpenMPI  
 12/19/07 07:59   1.2  
 AM


 Please respond
   to  
 Open MPI Users
 








oops, I meant -mca, not -mcs


> -Original Message-
> From: users-boun...@open-mpi.org
> [mailto:users-boun...@open-mpi.org] On Behalf Of Caird, Andrew J
> Sent: Wednesday, December 19, 2007 8:57 AM
> To: Open MPI Users
> Cc: users-boun...@open-mpi.org
> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
>
> Does OMPI built with TM but run with:
>-mcs pls ^tm
>
> give the same effect?
>
> --andy
>
>
> > -Original Message-
> > From: users-boun...@open-mpi.org
> > [mailto:users-boun...@open-mpi.org] On Behalf Of
> > pat.o'bry...@exxonmobil.com
> > Sent: Wednesday, December 19, 2007 8:47 AM
> > To: Open MPI Users
> > Cc: Open MPI Users; users-boun...@open-mpi.org
> > Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> >
> > Terry,
> > Your suggestion worked. So long as I specifically state
> > "--without-tm",
> > the OpenMPI 1.2.4 build allows the use of "-hostfile".
> Apparently, by
> > default, OpenMPI 1.2.4 will incorporate Torque if it
> exists, so it is
> > necessary to specifically request "no Torque support".  I
> > used the normal
> > Torque processes to submit the job and specified "-hostfile
> > $PBS_NODEFILE".
> > Everything worked.
> >Thanks for your help,
> > Pat
> >
> > J.W. (Pat) O'Bryant,Jr.
> > Business Line Infrastructure
> > Technical Systems, HPC
> > Office: 713-431-7022
> >
> >
> >
> >
> >
> >  Terry
> >
> >  Frankcombe
> >
> >   >   To
> >  .se> Open MPI Users
> > 
> >  Sent by:
> >   cc
> >  users-bounces@
> >
> >  open-mpi.org
> >  Subject
> >   Re: [OMPI users] Torque
> > and OpenMPI
> >   1.2
> >
> >  12/18/07 01:45
> >
> >  PM
> >
> >
> >
> >
> >
> >  Please respond
> >
> >to
> >
> >  Open MPI Users
> >
> >   >
> >  i.org>
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Tue, 2007-12-18 at 11:59 -0700, Ralph H Castain wrote:
> > > Hate to be a party-pooper, but the answer is "no" in
> OpenMPI 1.2. We
> > don't
> > > allow the use of a hostfile in a Torque environment in
> that version.
> > >
> > > We have changed this for v1.3, but you'll have to wait for
> > that release.
> >
> >
> > Can one not build OpenMPI without tm support and spawn remote
> > jobs using
> > the other mechanisms, using only $PBS_NODEFILE (or a
> derivative of the
> > file that that points to) in the script?
> >
> > Ciao
> > Terry
> >
> >
> > --
> > Dr Terry Frankcombe
> > Physical Chemistry, Department of Chemistry
> > Göteborgs Universitet
> > SE-412 96 Göteborg Sweden
> > Ph: +46 76 224 0887   Skype: terry.frankcombe
> > 
> >
> > ___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
> >
> >
> > ___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
> >
>
> ___
> users 

Re: [OMPI users] Theoretical Differences: Cluster Computing, Distributed Computing, Grid Computing

[Jeff Squyres]

It's a pretty hazy difference; I don't think there are formal  
definitions for each.


Cluster computing *usually* (but not always) implies a bit more  
tightly coupled set of computing: the app communicates and coordinates  
between itself more than your standard manager/worker computation  
model.  Distributed computing *usually* focuses on the manager/worker  
model -- send some work to anyone who asks for it and then eventually  
get some results back from them (or not -- then you have to send the  
same work out to someone else).


But you can certainly use the manager/worker model in cluster  
computing, too.  Not all cluster computing is tightly coupled.


Probably the easiest distinction is that "cluster computing" occurs on  
a cluster; distributed computing [usually] occurs in a larger-than-a- 
SAN area.



On Dec 19, 2007, at 1:10 AM, Amit Kumar Saha wrote:


Hi all!

I am a bit hazy about the differences between Distributed Computing
and Cluster Computing.

This document here
http://www.ibm.com/developerworks/grid/library/gr-heritage/ is a nice
read on Grid Computing and it also has few lines about important
differences from Cluster Computing.

Hints will be duly appreciated!

Thanks,
Amit
--
Amit Kumar Saha
Writer, Programmer, Researcher
http://amitsaha.in.googlepages.com
http://amitksaha.blogspot.com
___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users



--
Jeff Squyres
Cisco Systems

Re: [OMPI users] Torque and OpenMPI 1.2

[Caird, Andrew J]

oops, I meant -mca, not -mcs


> -Original Message-
> From: users-boun...@open-mpi.org 
> [mailto:users-boun...@open-mpi.org] On Behalf Of Caird, Andrew J
> Sent: Wednesday, December 19, 2007 8:57 AM
> To: Open MPI Users
> Cc: users-boun...@open-mpi.org
> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> 
> Does OMPI built with TM but run with:
>-mcs pls ^tm
> 
> give the same effect?
> 
> --andy
>   
> 
> > -Original Message-
> > From: users-boun...@open-mpi.org 
> > [mailto:users-boun...@open-mpi.org] On Behalf Of 
> > pat.o'bry...@exxonmobil.com
> > Sent: Wednesday, December 19, 2007 8:47 AM
> > To: Open MPI Users
> > Cc: Open MPI Users; users-boun...@open-mpi.org
> > Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> > 
> > Terry,
> > Your suggestion worked. So long as I specifically state 
> > "--without-tm",
> > the OpenMPI 1.2.4 build allows the use of "-hostfile". 
> Apparently, by
> > default, OpenMPI 1.2.4 will incorporate Torque if it 
> exists, so it is
> > necessary to specifically request "no Torque support".  I 
> > used the normal
> > Torque processes to submit the job and specified "-hostfile 
> > $PBS_NODEFILE".
> > Everything worked.
> >Thanks for your help,
> > Pat
> > 
> > J.W. (Pat) O'Bryant,Jr.
> > Business Line Infrastructure
> > Technical Systems, HPC
> > Office: 713-431-7022
> > 
> > 
> > 
> >   
> >  
> >  Terry
> >  
> >  Frankcombe   
> >  
> >   >   To 
> >  .se> Open MPI Users 
> >   
> >  Sent by: 
> >   cc 
> >  users-bounces@   
> >  
> >  open-mpi.org 
> >  Subject 
> >   Re: [OMPI users] Torque 
> > and OpenMPI  
> >   1.2 
> >  
> >  12/18/07 01:45   
> >  
> >  PM   
> >  
> >   
> >  
> >   
> >  
> >  Please respond   
> >  
> >to 
> >  
> >  Open MPI Users   
> >  
> >   >  
> >  i.org>   
> >  
> >   
> >  
> >   
> >  
> >   
> >  
> >   
> >  
> > 
> > 
> > 
> > 
> > On Tue, 2007-12-18 at 11:59 -0700, Ralph H Castain wrote:
> > > Hate to be a party-pooper, but the answer is "no" in 
> OpenMPI 1.2. We
> > don't
> > > allow the use of a hostfile in a Torque environment in 
> that version.
> > >
> > > We have changed this for v1.3, but you'll have to wait for 
> > that release.
> > 
> > 
> > Can one not build OpenMPI without tm support and spawn remote 
> > jobs using
> > the other mechanisms, using only $PBS_NODEFILE (or a 
> derivative of the
> > file that that points to) in the script?
> > 
> > Ciao
> > Terry
> > 
> > 
> > --
> > Dr Terry Frankcombe
> > Physical Chemistry, Department of Chemistry
> > Göteborgs Universitet
> > SE-412 96 Göteborg Sweden
> > Ph: +46 76 224 0887   Skype: terry.frankcombe
> > 
> > 
> > ___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
> > 
> > 
> > ___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
> > 
> 
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 

Re: [OMPI users] Torque and OpenMPI 1.2

[Caird, Andrew J]

Does OMPI built with TM but run with:
   -mcs pls ^tm

give the same effect?

--andy


> -Original Message-
> From: users-boun...@open-mpi.org 
> [mailto:users-boun...@open-mpi.org] On Behalf Of 
> pat.o'bry...@exxonmobil.com
> Sent: Wednesday, December 19, 2007 8:47 AM
> To: Open MPI Users
> Cc: Open MPI Users; users-boun...@open-mpi.org
> Subject: Re: [OMPI users] Torque and OpenMPI 1.2
> 
> Terry,
> Your suggestion worked. So long as I specifically state 
> "--without-tm",
> the OpenMPI 1.2.4 build allows the use of "-hostfile". Apparently, by
> default, OpenMPI 1.2.4 will incorporate Torque if it exists, so it is
> necessary to specifically request "no Torque support".  I 
> used the normal
> Torque processes to submit the job and specified "-hostfile 
> $PBS_NODEFILE".
> Everything worked.
>Thanks for your help,
> Pat
> 
> J.W. (Pat) O'Bryant,Jr.
> Business Line Infrastructure
> Technical Systems, HPC
> Office: 713-431-7022
> 
> 
> 
>   
>  
>  Terry
>  
>  Frankcombe   
>  
>     To 
>  .se> Open MPI Users 
>   
>  Sent by: 
>   cc 
>  users-bounces@   
>  
>  open-mpi.org 
>  Subject 
>   Re: [OMPI users] Torque 
> and OpenMPI  
>   1.2 
>  
>  12/18/07 01:45   
>  
>  PM   
>  
>   
>  
>   
>  
>  Please respond   
>  
>to 
>  
>  Open MPI Users   
>  
>    
>  i.org>   
>  
>   
>  
>   
>  
>   
>  
>   
>  
> 
> 
> 
> 
> On Tue, 2007-12-18 at 11:59 -0700, Ralph H Castain wrote:
> > Hate to be a party-pooper, but the answer is "no" in OpenMPI 1.2. We
> don't
> > allow the use of a hostfile in a Torque environment in that version.
> >
> > We have changed this for v1.3, but you'll have to wait for 
> that release.
> 
> 
> Can one not build OpenMPI without tm support and spawn remote 
> jobs using
> the other mechanisms, using only $PBS_NODEFILE (or a derivative of the
> file that that points to) in the script?
> 
> Ciao
> Terry
> 
> 
> --
> Dr Terry Frankcombe
> Physical Chemistry, Department of Chemistry
> Göteborgs Universitet
> SE-412 96 Göteborg Sweden
> Ph: +46 76 224 0887   Skype: terry.frankcombe
> 
> 
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 
> 
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 

Re: [OMPI users] new to MPI+infiniband

[Jeff Squyres]

In general, you need a functioning IB subsystem on your machines for  
OMPI to build for and use IB.  This includes both the set of kernel  
drivers and the userspace libraries.  In particular, Open MPI v1.2  
uses the "ibverbs" library.  If OMPI can find the ibverbs library and  
headers during its configure phase, it will build IB support and try  
to use it at run time.


You can see if OMPI finds what it needs in the stdout of configure --  
search for the string "openib" and see where it configures the BTL  
openib component.  If it ends with a message indicating that it will  
compile the openib BTL component, then you're good.  If not, you'll  
see some specific tests that fail that indicate why it won't include  
that support (e.g., can't find the right header files or somesuch).



On Dec 19, 2007, at 8:49 AM, pat.o'bry...@exxonmobil.com wrote:


Brian,
   Here is how I do it:

./configure --prefix /opt/openmpi-1.2.4 --with-openib=/usr/local/ 
ofed \

--without-tm CC=icc CXX=icpc F77=ifort FC=ifort \
--with-threads=posix --enable-mpi-threads


J.W. (Pat) O'Bryant,Jr.
Business Line Infrastructure
Technical Systems, HPC
Office: 713-431-7022




"Brian Budge"
  To

Sent by: "Open MPI Users"
users-bounces@   
open- 
mpi.org   cc


   
Subject
12/19/07 12:35   [OMPI users] new to MPI 
+infiniband

AM


Please respond
  to
Open MPI Users









Hi all -

I have been using OpenMPI for quite a while now, and its working out  
great.
I was looking at the FAQ and trying to figure out how to configure  
OpenMPI
with infiniband.  It shows how to enable IB pointing to the OFED  
directory.



I have infiniband built into the kernel, along with IP over IB and  
with the

Mellanox drivers.  What would I still need to install, and how would I
configure OpenMPI to work with this?

Thanks,
 Brian___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users

___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users



--
Jeff Squyres
Cisco Systems

Re: [OMPI users] new to MPI+infiniband

[pat . o'bryant]

Brian,
Here is how I do it:

./configure --prefix /opt/openmpi-1.2.4 --with-openib=/usr/local/ofed \
--without-tm CC=icc CXX=icpc F77=ifort FC=ifort \
--with-threads=posix --enable-mpi-threads


J.W. (Pat) O'Bryant,Jr.
Business Line Infrastructure
Technical Systems, HPC
Office: 713-431-7022




 "Brian Budge" 
   To 
 Sent by: "Open MPI Users" 
 users-bounces@    
 open-mpi.org   cc 

   Subject 
 12/19/07 12:35   [OMPI users] new to MPI+infiniband   
 AM


 Please respond
   to  
 Open MPI Users
 








Hi all -

I have been using OpenMPI for quite a while now, and its working out great.
I was looking at the FAQ and trying to figure out how to configure OpenMPI
with infiniband.  It shows how to enable IB pointing to the OFED directory.


I have infiniband built into the kernel, along with IP over IB and with the
Mellanox drivers.  What would I still need to install, and how would I
configure OpenMPI to work with this?

Thanks,
  Brian___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users

Re: [OMPI users] Torque and OpenMPI 1.2

[pat . o'bryant]

Terry,
Your suggestion worked. So long as I specifically state "--without-tm",
the OpenMPI 1.2.4 build allows the use of "-hostfile". Apparently, by
default, OpenMPI 1.2.4 will incorporate Torque if it exists, so it is
necessary to specifically request "no Torque support".  I used the normal
Torque processes to submit the job and specified "-hostfile $PBS_NODEFILE".
Everything worked.
   Thanks for your help,
Pat

J.W. (Pat) O'Bryant,Jr.
Business Line Infrastructure
Technical Systems, HPC
Office: 713-431-7022




 Terry 
 Frankcombe
  Open MPI Users   
 Sent by:   cc 
 users-bounces@
 open-mpi.org  Subject 
  Re: [OMPI users] Torque and OpenMPI  
  1.2  
 12/18/07 01:45
 PM


 Please respond
   to  
 Open MPI Users
 








On Tue, 2007-12-18 at 11:59 -0700, Ralph H Castain wrote:
> Hate to be a party-pooper, but the answer is "no" in OpenMPI 1.2. We
don't
> allow the use of a hostfile in a Torque environment in that version.
>
> We have changed this for v1.3, but you'll have to wait for that release.


Can one not build OpenMPI without tm support and spawn remote jobs using
the other mechanisms, using only $PBS_NODEFILE (or a derivative of the
file that that points to) in the script?

Ciao
Terry


--
Dr Terry Frankcombe
Physical Chemistry, Department of Chemistry
Göteborgs Universitet
SE-412 96 Göteborg Sweden
Ph: +46 76 224 0887   Skype: terry.frankcombe


___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users

[OMPI users] new to MPI+infiniband

[Brian Budge]

Hi all -

I have been using OpenMPI for quite a while now, and its working out great.
I was looking at the FAQ and trying to figure out how to configure OpenMPI
with infiniband.  It shows how to enable IB pointing to the OFED directory.

I have infiniband built into the kernel, along with IP over IB and with the
Mellanox drivers.  What would I still need to install, and how would I
configure OpenMPI to work with this?

Thanks,
  Brian

[OMPI users] Theoretical Differences: Cluster Computing, Distributed Computing, Grid Computing

[Amit Kumar Saha]

Hi all!

I am a bit hazy about the differences between Distributed Computing
and Cluster Computing.

This document here
http://www.ibm.com/developerworks/grid/library/gr-heritage/ is a nice
read on Grid Computing and it also has few lines about important
differences from Cluster Computing.

Hints will be duly appreciated!

Thanks,
Amit
-- 
Amit Kumar Saha
Writer, Programmer, Researcher
http://amitsaha.in.googlepages.com
http://amitksaha.blogspot.com