Re: [OMPI users] static, standalone mpirun (Jeff Squyres)
Dear Jeff, here I meant "" simply my local installation space... > ./configure --prefix= --without-memory-manager CXX=icpc CC=icc > F77=ifort FC=ifort LDFLAGS=--static --disable-shared --enable-static In between I managed to fix the relocated static, standalone mpirun (v 1.6.1): beyond the mpirun exec, the share/openmpi directory a had to copy also the etc/ directory, containing openmpi-default-hostfile and other files. Wrt to your example, I moving my statically linked mpirun and related directories share+etc to other servers on which I am lauching parallel jobs. Regards, Miro -- Message: 1 List-Post: users@lists.open-mpi.org Date: Tue, 25 Sep 2012 17:22:49 +0200 From: Jeff Squyres Subject: Re: [OMPI users] static, standalone mpirun To: Open MPI Users Message-ID: <7fba-18bc-4dde-8451-79960762f...@cisco.com> Content-Type: text/plain; charset=us-ascii Sorry for jumping in late in this thread. More below. On Sep 20, 2012, at 1:43 PM, Ilias Miroslav wrote: > I prepared my own static OpenMPI files (mpirun, mpif90...) within > openmpi-1.6.1.tar.gz > > ./configure --prefix= --without-memory-manager CXX=icpc CC=icc > F77=ifort FC=ifort LDFLAGS=--static --disable-shared --enable-static What is the exact value of "" that you are putting in? Are you actually putting in a space (i.e., " ")? That does not work for me -- configure errors out because the prefix was not an absolute path. More specifically, can you detail the exact commands you used to configure, build, install, relocate, and then try to run the relocated Open MPI? For example, I am able to do the following: - % ./configure --prefix=/home/jsquyres/bogus --disable-mpi-fortran --disable-vt --disable-mpi-cxx --disable-mpi-io --enable-mpirun-prefix-by-default --disable-shared --enable-static <...lots of output snipped...> % make install > /dev/null % cat <> /home/jsquyres/bogus/etc/openmpi-default-hostfile ? svbu-mpi027 ? svbu-mpi029 ? EOF % mpirun -np 2 hostname svbu-mpi027 svbu-mpi029 % mv /home/jsquyres/bogus /home/jsquyres/bogus2 % setenv OPAL_PREFIX /home/jsquyres/bogus2 % set path = (/home/jsquyres/bogus2/bin $path) % mpirun -np 2 hostname svbu-mpi027 svbu-mpi029 % - And it seems to work for me. Are you doing something different? -- Jeff Squyres jsquy...@cisco.com For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/ -- ___ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users End of users Digest, Vol 2364, Issue 4 **
Re: [OMPI users] static, standalone mpirun
Sorry for jumping in late in this thread. More below. On Sep 20, 2012, at 1:43 PM, Ilias Miroslav wrote: > I prepared my own static OpenMPI files (mpirun, mpif90...) within > openmpi-1.6.1.tar.gz > > ./configure --prefix= --without-memory-manager CXX=icpc CC=icc > F77=ifort FC=ifort LDFLAGS=--static --disable-shared --enable-static What is the exact value of "" that you are putting in? Are you actually putting in a space (i.e., " ")? That does not work for me -- configure errors out because the prefix was not an absolute path. More specifically, can you detail the exact commands you used to configure, build, install, relocate, and then try to run the relocated Open MPI? For example, I am able to do the following: - % ./configure --prefix=/home/jsquyres/bogus --disable-mpi-fortran --disable-vt --disable-mpi-cxx --disable-mpi-io --enable-mpirun-prefix-by-default --disable-shared --enable-static <...lots of output snipped...> % make install > /dev/null % cat <> /home/jsquyres/bogus/etc/openmpi-default-hostfile ? svbu-mpi027 ? svbu-mpi029 ? EOF % mpirun -np 2 hostname svbu-mpi027 svbu-mpi029 % mv /home/jsquyres/bogus /home/jsquyres/bogus2 % setenv OPAL_PREFIX /home/jsquyres/bogus2 % set path = (/home/jsquyres/bogus2/bin $path) % mpirun -np 2 hostname svbu-mpi027 svbu-mpi029 % - And it seems to work for me. Are you doing something different? -- Jeff Squyres jsquy...@cisco.com For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/
Re: [OMPI users] static, standalone mpirun
Not entirely sure I'd call it a bug just yet, but attached is a patch you can use that should help your situation. The 1.6 release manager is out-of-country this week, so I haven't heard back yet as to whether or not he wants this change in the official release. Ralph prefix.diff Description: Binary data On Sep 24, 2012, at 11:26 AM, Ilias Miroslav wrote: > Hi, > >> Sorry, I should have been clearer - I was asking if the path in the error >> message was indeed OPAL_PREFIX/etc/ I gather from your message that it >> is not. At the moment, it appears to be set to the install location, and >> probably isn't looking at OPAL_PREFIX. > > yes, the path in error message is $OPAL_PREFIX/etc/openmpi-default-hostfile > > what else shall I check to help to fix this bug please ? > > Best, > > M. > > il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.mpirun > -v -np 1 ./dirac.x > -- > Open RTE was unable to open the hostfile: > > /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile > Check to make sure the path and filename are correct. > -- > [sparc:09036] [[3051,0],0] ORTE_ERROR_LOG: Not found in file > base/ras_base_allocate.c at line 200 > [sparc:09036] [[3051,0],0] ORTE_ERROR_LOG: Not found in file > base/plm_base_launch_support.c at line 99 > [sparc:09036] [[3051,0],0] ORTE_ERROR_LOG: Not found in file plm_rsh_module.c > at line 1167 > > il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.echo > $OPAL_PREFIX > /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC > > il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.echo > $PATH > /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC:/home/ilias/bin:/usr/local/bin:/usr/bin:/bin:/usr/games:/home/ilias/bin:. > il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/. > > il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.ldd > mpirun >not a dynamic executable > > il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.ls > -l share/openmpi/ > total 336K > drwxr-xr-x 2 ilias ilias 4.0K 2012-09-22 22:08 amca-param-sets/ > -rw-r--r-- 1 ilias ilias 618 2012-09-22 22:08 help-coll-sync.txt > . > . > . > > ___ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users
Re: [OMPI users] static, standalone mpirun
Hi, > Sorry, I should have been clearer - I was asking if the path in the error > message was indeed OPAL_PREFIX/etc/ I gather from your message that it is > not. At the moment, it appears to be set to the install location, and > probably isn't looking at OPAL_PREFIX. yes, the path in error message is $OPAL_PREFIX/etc/openmpi-default-hostfile what else shall I check to help to fix this bug please ? Best, M. il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.mpirun -v -np 1 ./dirac.x -- Open RTE was unable to open the hostfile: /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile Check to make sure the path and filename are correct. -- [sparc:09036] [[3051,0],0] ORTE_ERROR_LOG: Not found in file base/ras_base_allocate.c at line 200 [sparc:09036] [[3051,0],0] ORTE_ERROR_LOG: Not found in file base/plm_base_launch_support.c at line 99 [sparc:09036] [[3051,0],0] ORTE_ERROR_LOG: Not found in file plm_rsh_module.c at line 1167 il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.echo $OPAL_PREFIX /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.echo $PATH /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC:/home/ilias/bin:/usr/local/bin:/usr/bin:/bin:/usr/games:/home/ilias/bin:. il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/. il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.ldd mpirun not a dynamic executable il...@sparc.fpv.umb.sk:~/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/.ls -l share/openmpi/ total 336K drwxr-xr-x 2 ilias ilias 4.0K 2012-09-22 22:08 amca-param-sets/ -rw-r--r-- 1 ilias ilias 618 2012-09-22 22:08 help-coll-sync.txt . . .
Re: [OMPI users] static, standalone mpirun
On Sep 22, 2012, at 11:11 PM, Ilias Miroslav wrote: > Hello, > >> Is the path correct for the new location? > > yes, the $PATH points to the location of the sole static "mpirun" and of the > share/openmpi/*.txt directory. > > Why is mpirun constructing $/etc/openmpi-default-hostfile as > I see in the error message below ? > ( > /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile > ) Sorry, I should have been clearer - I was asking if the path in the error message was indeed OPAL_PREFIX/etc/ I gather from your message that it is not. At the moment, it appears to be set to the install location, and probably isn't looking at OPAL_PREFIX. I can look into it. > >>> Check to make sure the path and filename are correct. > Please what others variables/files do I have to set/copy with the static > mpirun ? > I am setting (experience from previous OpenMPI versions) OPAL_PREFIX, which > is location of my static mpirun. > > The wish is to distribute own static mpirun with related necessary files to > other servers to be able to launch static parallel applications there. > > Thanks, Miro > > On Sep 20, 2012, at 5:15 AM, Ilias Miroslav > wrote: >> Hi again, >> >> as I checked the mailing list - isn't it this bug showing up again in static >> version ? >> >> http://www.open-mpi.org/community/lists/users/2012/05/19278.php >> >> M >> >> From: Ilias Miroslav >> Sent: Thursday, September 20, 2012 1:43 PM >> To: users_at_[hidden] >> Subject: static, standalone mpirun >> >> Greetings, >> >> I prepared my own static OpenMPI files (mpirun, mpif90...) within >> openmpi-1.6.1.tar.gz >> >> ./configure --prefix= --without-memory-manager CXX=icpc CC=icc >> F77=ifort FC=ifort LDFLAGS=--static --disable-shared --enable-static >> >> and I was trying to launch parallel job at other machine (I specified the >> OPAL_PREFIX variable and also copied share/openmi directory there). >> >> However, I got this error - please what am I missing ? Thanks, Miro >> >> ./mpirun --np 1 dirac.x >> -- >> Open RTE was unable to open the hostfile: >> >> /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile >> Check to make sure the path and filename are correct. >> -- >> [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file >> base/ras_base_allocate.c at line 200 >> [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file >> base/plm_base_launch_support.c at line 99 >> [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file >> plm_rsh_module.c at line 1167 >> > > ___ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users
Re: [OMPI users] static, standalone mpirun
Hello, > Is the path correct for the new location? yes, the $PATH points to the location of the sole static "mpirun" and of the share/openmpi/*.txt directory. Why is mpirun constructing $/etc/openmpi-default-hostfile as I see in the error message below ? ( /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile ) > > Check to make sure the path and filename are correct. Please what others variables/files do I have to set/copy with the static mpirun ? I am setting (experience from previous OpenMPI versions) OPAL_PREFIX, which is location of my static mpirun. The wish is to distribute own static mpirun with related necessary files to other servers to be able to launch static parallel applications there. Thanks, Miro On Sep 20, 2012, at 5:15 AM, Ilias Miroslav wrote: > Hi again, > > as I checked the mailing list - isn't it this bug showing up again in static > version ? > > http://www.open-mpi.org/community/lists/users/2012/05/19278.php > > M > > From: Ilias Miroslav > Sent: Thursday, September 20, 2012 1:43 PM > To: users_at_[hidden] > Subject: static, standalone mpirun > > Greetings, > > I prepared my own static OpenMPI files (mpirun, mpif90...) within > openmpi-1.6.1.tar.gz > > ./configure --prefix= --without-memory-manager CXX=icpc CC=icc > F77=ifort FC=ifort LDFLAGS=--static --disable-shared --enable-static > > and I was trying to launch parallel job at other machine (I specified the > OPAL_PREFIX variable and also copied share/openmi directory there). > > However, I got this error - please what am I missing ? Thanks, Miro > > ./mpirun --np 1 dirac.x > -- > Open RTE was unable to open the hostfile: > > /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile > Check to make sure the path and filename are correct. > -- > [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file > base/ras_base_allocate.c at line 200 > [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file > base/plm_base_launch_support.c at line 99 > [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file > plm_rsh_module.c at line 1167 >
Re: [OMPI users] static, standalone mpirun
Is the path correct for the new location? On Sep 20, 2012, at 5:15 AM, Ilias Miroslav wrote: > Hi again, > > as I checked the mailing list - isn't it this bug showing up again in static > version ? > > http://www.open-mpi.org/community/lists/users/2012/05/19278.php > > M > > From: Ilias Miroslav > Sent: Thursday, September 20, 2012 1:43 PM > To: us...@open-mpi.org > Subject: static, standalone mpirun > > Greetings, > > I prepared my own static OpenMPI files (mpirun, mpif90...) within > openmpi-1.6.1.tar.gz > > ./configure --prefix= --without-memory-manager CXX=icpc CC=icc > F77=ifort FC=ifort LDFLAGS=--static --disable-shared --enable-static > > and I was trying to launch parallel job at other machine (I specified the > OPAL_PREFIX variable and also copied share/openmi directory there). > > However, I got this error - please what am I missing ? Thanks, Miro > > ./mpirun --np 1 dirac.x > -- > Open RTE was unable to open the hostfile: > > /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile > Check to make sure the path and filename are correct. > -- > [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file > base/ras_base_allocate.c at line 200 > [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file > base/plm_base_launch_support.c at line 99 > [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file > plm_rsh_module.c at line 1167 > > ___ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users
Re: [OMPI users] static, standalone mpirun
Hi again, as I checked the mailing list - isn't it this bug showing up again in static version ? http://www.open-mpi.org/community/lists/users/2012/05/19278.php M From: Ilias Miroslav Sent: Thursday, September 20, 2012 1:43 PM To: us...@open-mpi.org Subject: static, standalone mpirun Greetings, I prepared my own static OpenMPI files (mpirun, mpif90...) within openmpi-1.6.1.tar.gz ./configure --prefix= --without-memory-manager CXX=icpc CC=icc F77=ifort FC=ifort LDFLAGS=--static --disable-shared --enable-static and I was trying to launch parallel job at other machine (I specified the OPAL_PREFIX variable and also copied share/openmi directory there). However, I got this error - please what am I missing ? Thanks, Miro ./mpirun --np 1 dirac.x -- Open RTE was unable to open the hostfile: /home/ilias/work/dirac/build_Intel_OpenMPI_MKL_ILP64_STATIC/etc/openmpi-default-hostfile Check to make sure the path and filename are correct. -- [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file base/ras_base_allocate.c at line 200 [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file base/plm_base_launch_support.c at line 99 [sparc:23537] [[29526,0],0] ORTE_ERROR_LOG: Not found in file plm_rsh_module.c at line 1167
