Re: [OMPI users] error on dlopen

2016-11-04 Thread Mahmood Naderan
>​What problems are you referring to? I mean errors that are saying failed to load X.so. Then the user has to add some paths to LD_LIBRARY_PATH. Although such problem can be fixed by adding an export to the .bashrc, but I prefer to avoid that. >We might need a bit more detail than that; I use "--

Re: [OMPI users] error on dlopen

2016-11-04 Thread Jeff Squyres (jsquyres)
On Nov 4, 2016, at 12:14 PM, Mahmood Naderan wrote: > > >​If there's a reason you did --enable-static --disable-shared​ > Basically, I want to prevent dynamic library problems (ldd) on a distributed > environment. What problems are you referring to? > $ mpifort --showme > gfortran -I/opt/openm

Re: [OMPI users] error on dlopen

2016-11-04 Thread Mahmood Naderan
>​If there's a reason you did --enable-static --disable-shared​ Basically, I want to prevent dynamic library problems (ldd) on a distributed environment. ​$ mpifort --showme gfortran -I/opt/openmpi-2.0.1/include -pthread -I/opt/openmpi-2.0.1/lib -Wl,-rpath -Wl,/opt/openmpi-2.0.1/lib -Wl,--enable-

Re: [OMPI users] error on dlopen

2016-11-04 Thread Jeff Squyres (jsquyres)
> On Nov 4, 2016, at 7:07 AM, Mahmood Naderan wrote: > > > You might have to remove -ldl from the scalapack makefile > I removed that before... I will try one more time > > Actually, using --disable-dlopen fixed the error. To clarify: 1. Using --enable-static causes all the plugins in Open MPI

Re: [OMPI users] error on dlopen

2016-11-04 Thread Mahmood Naderan
> You might have to remove -ldl from the scalapack makefile I removed that before... I will try one more time Actually, using --disable-dlopen fixed the error. >mpirun --showme $ mpirun --showme mpirun: Error: unknown option "--showme" Type 'mpirun --help' for usage. Regards, Mahmood On Fri

Re: [OMPI users] error on dlopen

2016-11-04 Thread Gilles Gouaillardet
You might have to remove -ldl from the scalapack makefile If it still does not work, can you please post mpirun --showme ... output ? Cheers, Gilles On Friday, November 4, 2016, Mahmood Naderan wrote: > Hi Gilles, > I noticed that /opt/openmpi-2.0.1/share/openmpi/mpifort-wrapper-data.txt > is

Re: [OMPI users] error on dlopen

2016-11-04 Thread Mahmood Naderan
Hi Gilles, I noticed that /opt/openmpi-2.0.1/share/openmpi/mpifort-wrapper-data.txt is created after "make install". So, I edited it and appended -ldl to libs_static. Then I ran "make clean && make all" for scalapack. However, still get the same error!! So, let me try disabling dlopen. Regards,

Re: [OMPI users] error on dlopen

2016-11-04 Thread Gilles Gouaillardet
not much difference from a performance point of view. the difference is more from a space (both memory and disk) point of view also, if you --disable-dlopen, Open MPI is rebuilt when a single component is updated. (without it, you can simply make install from the updated component directory

Re: [OMPI users] error on dlopen

2016-11-04 Thread Mahmood Naderan
I will try that. Meanwhile, I want to know what is the performance effect of disabling/enabling dlopen? Regards, Mahmood On Fri, Nov 4, 2016 at 11:02 AM, Gilles Gouaillardet wrote: > Yes, that is a problem :-( > > > you might want to reconfigure with > > --enable-static --disable-shared --dis

Re: [OMPI users] error on dlopen

2016-11-04 Thread Gilles Gouaillardet
Yes, that is a problem :-( you might want to reconfigure with --enable-static --disable-shared --disable-dlopen and see if it helps or you can simply manuall edit /opt/openmpi-2.0.1/share/openmpi/mpifort-wrapper-data.txt, and append -ldl to the libs_static definition Cheers, Gilles O

Re: [OMPI users] error on dlopen

2016-11-04 Thread Mahmood Naderan
>did you build Open MPI as a static only library ? Yes, I used --enable-static --disable-shared Please see the output # mpifort -O3 -o xCbtest --showme blacstest.o btprim.o tools.o Cbt.o ../../libscalapack.a -ldl gfortran -O3 -o xCbtest blacstest.o btprim.o tools.o Cbt.o ../../libscalapack.a -ld

Re: [OMPI users] error on dlopen

2016-11-03 Thread Gilles Gouaillardet
Mahmood, did you build Open MPI as a static only library ? i guess the -ldl position is wrong. your link command line should be mpifort -O3 -o xCbtest blacstest.o btprim.o tools.o Cbt.o ../../libscalapack.a -ldl you can manually mpifort -O3 -o xCbtest --showme blacstest.o btprim.o tools.

Re: [OMPI users] error on dlopen

2016-11-03 Thread Mahmood Naderan
I added that but still get the same error. Please see the config file for building scalapack # cat SLmake.inc CDEFS = -DAdd_ FC= mpifort -ldl CC= mpicc NOOPT = -O0 FCFLAGS = -O3 CCFLAGS = -O3 FCLOADER = $(FC) CCLOADER = $(CC) FCLOADFLAG

Re: [OMPI users] error on dlopen

2016-11-03 Thread Sean Ahern
Sounds to me like you're missing a -ldl linker flag. -Sean -- Sean Ahern Computational Engineering International 919-363-0883 On Thu, Nov 3, 2016 at 3:57 PM, Mahmood Naderan wrote: > Hi > I am building scalapack with mpicc and mpifort, however this is the error > I get: > > mpifort -O3 -o xCbt