[OMPI devel] Communication between Torque and open MPI
Hi, Is anybody having a tutorial or reference pages explaining about the communication between Torque and open MPI? Thanks in advance. -- Thanks & Regards, Jayavant N. Patil
Re: [OMPI devel] TIPC BTL code ready for review
On 08/23/2011 04:35 PM, Jeff Squyres wrote: On Aug 23, 2011, at 9:54 AM, Xin He wrote: Hi, I modified the code, copyright comments added. I added your fixes to https://bitbucket.org/jsquyres/ompi-tipc. And about configure.m4, sorry I was not clear before, tipc.h is under /usr/include/linux/tipc.h, not under include directly. Can you edit your configure.m4 directly and test it and whatnot? I provided the configure.m4 as a starting point for you. :-) It shouldn't be hard to make it check linux/tipc.h instead of tipc.h. I'm happy to give you direct write access to the bitbucket, if you want it. I think me having write access is convenient for both of us :) As we've discussed off-list, we can't take the code upstream until the contributor agreement is signed, unfortunately. The agreement thing is ongoing right now, but it may take some time. But to save time, can you guys do some test on TIPC BTL, so that when the agreement is ready, the code can be used? I have done some tests using tools like NetPIPE, osu and IMB and the result shows that TIPC BTL has a better performance than TCP BTL. Great! Can you share any results? Yes, please check the appendix for the results using IMB 3.2. I have done the tests on 2 computers. Dell SC1435 Dual-Core AMD Opteron(tm) Processor 2212 HE x 2 4 GB Mem Ubuntu Server 10.04 LTS 32-bit Linux 2.6.32-24 Have you been able to compare it to the sm BTL? imb_result.tar Description: Unix tar archive
Re: [OMPI devel] [torquedev] Communication between Torque and MPI
On Thu, 25 Aug 2011 09:07:48 PM Jayavant Patil wrote: > Hi, Hiya, > Is anybody having a tutorial or reference pages > explaining about the communication between Torque > and MPI? Open-MPI uses the PBS Task Manager (TM) API to talk to Torque pbs_mom's. If you have the Torque manual pages installed you can "man tm" to see the docs. The code in Open-MPI that launches jobs is in the code: $openmpi/orte/mca/plm/tm/ Hope that helps! Chris -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.unimelb.edu.au/
Re: [OMPI devel] TIPC BTL code ready for review
On Aug 25, 2011, at 8:25 AM, Xin He wrote: >> Can you edit your configure.m4 directly and test it and whatnot? I provided >> the configure.m4 as a starting point for you. :-) It shouldn't be hard to >> make it check linux/tipc.h instead of tipc.h. I'm happy to give you direct >> write access to the bitbucket, if you want it. > I think me having write access is convenient for both of us :) Sure -- what's your bitbucket account ID? >> As we've discussed off-list, we can't take the code upstream until the >> contributor agreement is signed, unfortunately. >> > The agreement thing is ongoing right now, but it may take some time. No worries. Lawyers tend to take time when reviewing this stuff; we've seen this pattern in most organizations who sign the OMPI agreement. > But to save time, can you guys do some test on TIPC BTL, so that > when the agreement is ready, the code can be used? I don't know if any of us has the TIPC support libraries installed. So... what *is* TIPC? Is there a writeup anywhere that we can read about what it is / how it works? For example, what makes TIPC perform better than TCP? >>> I have done some tests using tools like NetPIPE, osu and IMB and the result >>> shows that TIPC BTL has a better performance >>> than TCP BTL. >> Great! Can you share any results? > Yes, please check the appendix for the results using IMB 3.2. > > I have done the tests on 2 computers. Dell SC1435 > Dual-Core AMD Opteron(tm) Processor 2212 HE x 2 > 4 GB Mem > Ubuntu Server 10.04 LTS 32-bit Linux 2.6.32-24 I'm not familiar with the Dell or Opteron lines -- how recent are those models? I ask because your TCP latency is a bit high (about 85us in 2-process IMB PingPong); it might suggest older hardware. Or you may have built a debugging version of Open MPI (if you have a .svn or .hg checkout, that's the default). See the HACKING top-level file for how to get an optimized build. For example, with my debug build of Open MPI on fairly old Xeons with 1GB ethernet, I'm getting the following PingPong results (note: this is a debug build; it's not even an optimized build): - $ mpirun --mca btl tcp,self --bynode -np 2 --mca btl_tcp_if_include eth0 hostname svbu-mpi008 svbu-mpi009 $ mpirun --mca btl tcp,self --bynode -np 2 --mca btl_tcp_if_include eth0 IMB-MPI1 PingPong #--- #Intel (R) MPI Benchmark Suite V3.2, MPI-1 part #--- ... #--- # Benchmarking PingPong # #processes = 2 #--- #bytes #repetitions t[usec] Mbytes/sec 0 100057.31 0.00 1 100057.71 0.02 2 100057.73 0.03 4 100057.81 0.07 8 100057.78 0.13 - With an optimized build, it shaves off only a few us (which isn't too important in this case, but it does matter in the low-latency transport cases): - #--- # Benchmarking PingPong # #processes = 2 #--- #bytes #repetitions t[usec] Mbytes/sec 0 100054.62 0.00 1 100054.92 0.02 2 100055.15 0.03 4 100055.16 0.07 8 100055.15 0.14 - -- Jeff Squyres jsquy...@cisco.com For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/
Re: [OMPI devel] [torquedev] Communication between Torque and MPI
Just an FYI: there are two other places where OMPI touches Torque. The code in orte/mca/ras/tm reads the Torque allocation, and the code in orte/mca/ess/tm lets the daemons obtain startup info when launched under Torque. On Aug 25, 2011, at 6:35 AM, Chris Samuel wrote: > On Thu, 25 Aug 2011 09:07:48 PM Jayavant Patil wrote: > >> Hi, > > Hiya, > >> Is anybody having a tutorial or reference pages >> explaining about the communication between Torque >> and MPI? > > Open-MPI uses the PBS Task Manager (TM) API to talk to > Torque pbs_mom's. If you have the Torque manual pages > installed you can "man tm" to see the docs. > > The code in Open-MPI that launches jobs is in the code: > > $openmpi/orte/mca/plm/tm/ > > Hope that helps! > Chris > -- > Christopher Samuel - Senior Systems Administrator > VLSCI - Victorian Life Sciences Computation Initiative > Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 > http://www.vlsci.unimelb.edu.au/ > ___ > devel mailing list > de...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/devel
Re: [OMPI devel] RFC: adding OMPIO module and new parallel I/O frameworks to trunk
the code has been committed in r25079. Let us know if there are any issues, compilation problems etc. I also work on an FAQ entry as has been suggested on the teleconf last week. Thanks Edgar On 8/12/2011 3:09 PM, Edgar Gabriel wrote: > WHAT: add the ompio io module and new parallel io frameworks to trunk > > TIMEOUT: 08/22/2011 > > DETAILS: > > we would like to bring the ompio module and the new parallel io > frameworks to the trunk to expose it to a wider set of platforms and > more widespread testing. The current functionality - while not yet > providing the full functionality of MPI I/O - is already useful, since > all blocking individual and collective I/O operations (arbitrary file > views, implicit and explicit offset) are supported. The missing > functionality ( non-blocking individual I/O and shared file pointers) > are currently being worked on and exist partially as stand-alone libraries. > > The current goal is to enable compilation of the new modules and > frameworks per default, but not use them unless explicitly requested by > the user, i.e. ROMIO will remain the default selection. > > Very little existing code is being touched, since most of the new code > are new frameworks and modules. If somebody would like to have a look at > the code and the changes, here isa public repository with the code. > > https://bitbucket.org/mschaara/ompio > > The list of modified files are: > ? ompi/mca/fbtl > ? ompi/mca/sharedfp > ? ompi/mca/fcoll > ? ompi/mca/fs > ? ompi/mca/fcache > ? ompi/mca/io/ompio > M ompi/mca/io/romio/src/io_romio_component.c > M ompi/mca/io/base/io_base_file_select.c > M ompi/mca/io/base/io_base_delete.c > ? ompi/config/ompi_check_pvfs2.m4 > ? ompi/config/ompi_check_lustre.m4 > > Feedback is highly welcome. > > Thanks > Edgar > > > > > ___ > devel mailing list > de...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/devel -- Edgar Gabriel Assistant Professor Parallel Software Technologies Lab http://pstl.cs.uh.edu Department of Computer Science University of Houston Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA Tel: +1 (713) 743-3857 Fax: +1 (713) 743-3335 signature.asc Description: OpenPGP digital signature
