Re: [OMPI users] MPI_THREAD_MULTIPLE and openib btl

I am using 2.4-1.0.0 mellanox ofed. I downloaded mofed tarball hpcx-v1.2.0-325-gcc-MLNX_OFED_LINUX-2.4-1.0.0-redhat6.5.tar and extracted it. It has mxm directory. hpcx-v1.2.0-325-[root@JARVICE ~]# ls hpcx-v1.2.0-325-gcc-MLNX_OFED_LINUX-2.4-1.0.0-redhat6.5 archive fca

Re: [OMPI users] Running mpi with different account

Xing, an other approach is to use ompi-server and Publish_name / Lookup_name : run ompi-server and pass the uri to two jobs (one per user) then you will have to "merge" the two jobs. this is obviously a bit more effort, but this is a cleaner approach imho. while sharing accounts is generally

Re: [OMPI users] Running mpi with different account

Thanks very much for your reply. I would report later if I succeed. On Tue, Apr 14, 2015 at 11:19 AM, Ralph Castain wrote: > > On Apr 13, 2015, at 5:47 PM, XingFENG wrote: > > Thanks for all who joined the discussion. > Yes, I meant to run the job

Re: [OMPI users] Running mpi with different account

> On Apr 13, 2015, at 5:47 PM, XingFENG wrote: > > Thanks for all who joined the discussion. > Yes, I meant to run the job under both accounts at the same time. > > Hi, Ralph, > > I have searched about specifying username in hostfile and got no related > page.

Re: [OMPI users] Problems using Open MPI 1.8.4 OSHMEM on Intel Xeon Phi/MIC

Weird. I’m not sure what to try at that point - IIRC, building static won’t resolve this problem (but you could try and see). You could add the following to the cmd line and see if it tells us anything useful: —leave-session-attached —mca mca_component_show_load_errors 1 You might also do an

Re: [OMPI users] Build error with gcc-4.9.2?

I should have mentioned that I was working on Linux. On 4/13/2015 5:34 PM, Ralph Castain wrote: Yeah, I verified that on a new machine (Mac OSX 10.10) everything built fine with gcc 4.9.2 - but that’s a new glibc On Apr 13, 2015, at 4:30 PM, John Cary

Re: [OMPI users] Build error with gcc-4.9.2?

Yeah, I verified that on a new machine (Mac OSX 10.10) everything built fine with gcc 4.9.2 - but that’s a new glibc > On Apr 13, 2015, at 4:30 PM, John Cary wrote: > > Thanks! > > Now found the related issue, > http://www.open-mpi.org/community/lists/users/2015/01/26134.php

Re: [OMPI users] Build error with gcc-4.9.2?

Thanks! Now found the related issue, http://www.open-mpi.org/community/lists/users/2015/01/26134.php We are similarly using a newer compiler (gcc-4.9.2) on an older machine (glibc-2.5). As noted in the above issue, upon adding -fgnu89-inline it built. J On 4/13/2015 4:25 PM,

Re: [OMPI users] Build error with gcc-4.9.2?

I believe I reported same some months back. I don't remember the outcome or whether I got it working. But you're not alone anyway. *Note: UMDNJ is now Rutgers-Biomedical and Health Sciences* || \\UTGERS |-*O*- ||_// Biomedical | Ryan Novosielski

[OMPI users] Build error with gcc-4.9.2?

I am seeing: Making all in tools/ompi_info make[2]: Entering directory `/scr_devlinux/cary/vorpalall/builds/openmpi-1.8.4/static/ompi/tools/ompi_info' CC ompi_info.o CC param.o CCLD ompi_info ../../../ompi/.libs/libmpi.a(strfns.o): In function `lstat64':

Re: [OMPI users] Problems using Open MPI 1.8.4 OSHMEM on Intel Xeon Phi/MIC

Ralph and Nathan, The problem may be something trivial, as I don't typically use "shmemrun" to start jobs. With the following, I *think* I've  demonstrated that the problem library is where it belongs on the remote system: $ ldd mic.out    

Re: [OMPI users] Problems using Open MPI 1.8.4 OSHMEM on Intel Xeon Phi/MIC

For talking between PHIs on the same system I recommend using the scif BTL NOT tcp. That said, it looks like the LD_LIBRARY_PATH is wrong on the remote system. It looks like it can't find the intel compiler libraries. -Nathan Hjelm HPC-5, LANL On Mon, Apr 13, 2015 at 04:06:21PM -0400, Andy

Re: [OMPI users] Problems using Open MPI 1.8.4 OSHMEM on Intel Xeon Phi/MIC

I don’t see that LD_PRELOAD showing up on the ssh path, Andy > /usr/bin/ssh mic1 PATH=/home/ariebs/mic/mpi-nightly/bin:$PATH ; export > PATH ; LD_LIBRARY_PATH=/home/ariebs/mic/mpi-nightly/lib:$LD_LIBRARY_PATH ; > export LD_LIBRARY_PATH ; >

Re: [OMPI users] Problems using Open MPI 1.8.4 OSHMEM on Intel Xeon Phi/MIC

Progress!  I can run my trivial program on the local PHI, but not the other PHI, on the system. Here are the interesting parts: A pretty good recipe with last night's nightly master: $ ./configure --prefix=/home/ariebs/mic/mpi-nightly CC="icc -mmic" CXX="icpc

Re: [OMPI users] mpi_type_create_struct not working for large counts

HI Stephan, For starters, would you mind sending the output you get when you run the ompi_info command? If you could, it would be great if you could try running the test against the latest 1.8.5rc1 ? The test appears

[OMPI users] mpi_type_create_struct not working for large counts

Hi there, I've got an issue when using a derived data type created by mpi_type_create_struct in a one-sided communication. The problem can be reproduced using the small standalone program which I attached. It just creates a type which should be equivalent to n contiguous elements. This type

Re: [OMPI users] Running mpi with different account

> On Apr 13, 2015, at 6:56 AM, Maxime Boissonneault > wrote: > > Le 2015-04-13 09:54, Ralph Castain a écrit : >>> On Apr 13, 2015, at 6:52 AM, Maxime Boissonneault >>> >>

Re: [OMPI users] Running mpi with different account

Le 2015-04-13 09:54, Ralph Castain a écrit : On Apr 13, 2015, at 6:52 AM, Maxime Boissonneault wrote: Just out of curiosity... how will OpenMPI start processes under different accounts ? Through SSH while specifying different user names ? I am assuming

Re: [OMPI users] Running mpi with different account

> On Apr 13, 2015, at 6:52 AM, Maxime Boissonneault > wrote: > > Just out of curiosity... how will OpenMPI start processes under different > accounts ? Through SSH while specifying different user names ? > I am assuming that no resource manager or

Re: [OMPI users] Running mpi with different account

Just out of curiosity... how will OpenMPI start processes under different accounts ? Through SSH while specifying different user names ? I am assuming that no resource manager or scheduler will allow this. My recommendation would be to contact your sysadmin and ask for an exception instead of

Re: [OMPI users] Running mpi with different account

Let’s hope you sys admin doesn’t find out about it - they tend to take a dim view of sharing accounts! So long as the path and library path are set correctly, we won’t care. > On Apr 12, 2015, at 10:33 PM, XingFENG wrote: > > Hi all, > > I am wondering if it is

Re: [OMPI users] Problems using Open MPI 1.8.4 OSHMEM on Intel Xeon Phi/MIC

Hi Ralph, Here are the results with last night's "master" nightly, openmpi-dev-1487-g9c6d452.tar.bz2, and adding the memheap_base_verbose option (yes, it looks like the "ERROR_LOG" problem has gone away): $ cat /proc/sys/kernel/shmmax 33554432 $ cat

Re: [OMPI users] MPI_THREAD_MULTIPLE and openib btl

seems like mxm was not found in your ld_library_path. what mofed version do you use? does it have /opt/mellanox/mxm in it? You could just run mpirun from HPCX package which looks for mxm internally and recompile ompi as mentioned in README. On Mon, Apr 13, 2015 at 3:24 AM, Subhra Mazumdar

[OMPI users] Running mpi with different account

Hi all, I am wondering if it is possible that MPI programs can be run on machines with different account? I am doing experiments with some MPI programs on a cluster. My problem is that my account is limited to use 4 machines (I need more machines to process data). I can borrow my friend's