Re: [OMPI users] error on dlopen

2016-11-03 Thread Gilles Gouaillardet

Mahmood,


did you build Open MPI as a static only library ?


i guess the -ldl position is wrong. your link command line should be

mpifort -O3 -o xCbtest blacstest.o btprim.o tools.o Cbt.o 
../../libscalapack.a -ldl



you can manually

mpifort -O3 -o xCbtest --showme blacstest.o btprim.o tools.o Cbt.o 
../../libscalapack.a -ldl



it should show -ldl is added *after* -lopen-pal


Cheers,

Gilles

On 11/4/2016 3:44 PM, Mahmood Naderan wrote:
I added that but still get the same error. Please see the config file 
for building scalapack


# cat SLmake.inc
CDEFS = -DAdd_
FC= mpifort -ldl
CC= mpicc
NOOPT = -O0
FCFLAGS   = -O3
CCFLAGS   = -O3
FCLOADER  = $(FC)
CCLOADER  = $(CC)
FCLOADFLAGS   = $(FCFLAGS)
CCLOADFLAGS   = $(CCFLAGS)
ARCH  = ar
ARCHFLAGS = cr
RANLIB= ranlib
SCALAPACKLIB  = libscalapack.a
BLASLIB   = /opt/OpenBLAS-0.2.18/libopenblas.a
LAPACKLIB =
LIBS  = $(LAPACKLIB) $(BLASLIB)




Regards,
Mahmood



On Fri, Nov 4, 2016 at 12:25 AM, Sean Ahern > wrote:


Sounds to me like you're missing a -ldl linker flag.

-Sean

--
Sean Ahern
Computational Engineering International
919-363-0883

On Thu, Nov 3, 2016 at 3:57 PM, Mahmood Naderan
mailto:mahmood...@gmail.com>> wrote:

Hi
I am building scalapack with mpicc and mpifort, however this
is the error I get:

mpifort -O3 -o xCbtest blacstest.o btprim.o tools.o Cbt.o
../../libscalapack.a
/opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In
function `dlopen_close':
dl_dlopen_module.c:(.text+0x29d): undefined reference to `dlclose'
/opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In
function `dlopen_lookup':
dl_dlopen_module.c:(.text+0x2d0): undefined reference to `dlsym'
dl_dlopen_module.c:(.text+0x2fb): undefined reference to `dlerror'
/opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In
function `dlopen_open':
dl_dlopen_module.c:(.text+0x3ca): undefined reference to `dlopen'
dl_dlopen_module.c:(.text+0x431): undefined reference to `dlerror'
dl_dlopen_module.c:(.text+0x456): undefined reference to `dlopen'
dl_dlopen_module.c:(.text+0x4a9): undefined reference to `dlerror'
dl_dlopen_module.c:(.text+0x501): undefined reference to `dlopen'
/opt/openmpi-2.0.1/lib/libopen-pal.a(patcher_overwrite_module.o):
In function `mca_patcher_overwrite_patch_symbol':
patcher_overwrite_module.c:(.text+0x12e): undefined reference
to `dlsym'
patcher_overwrite_module.c:(.text+0x166): undefined reference
to `dlsym'
patcher_overwrite_module.c:(.text+0x173): undefined reference
to `dlerror'
collect2: error: ld returned 1 exit status
Makefile:18: recipe for target 'xCbtest' failed
make[2]: *** [xCbtest] Error 1



As I grep "dlopen", some OMPI binary files match. Any idea
about that?


Regards,
Mahmood



___
users mailing list
users@lists.open-mpi.org 
https://rfd.newmexicoconsortium.org/mailman/listinfo/users




___
users mailing list
users@lists.open-mpi.org 
https://rfd.newmexicoconsortium.org/mailman/listinfo/users





___
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users


___
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users

Re: [OMPI users] error on dlopen

2016-11-03 Thread Mahmood Naderan
I added that but still get the same error. Please see the config file for
building scalapack

# cat SLmake.inc
CDEFS = -DAdd_
FC= mpifort -ldl
CC= mpicc
NOOPT = -O0
FCFLAGS   = -O3
CCFLAGS   = -O3
FCLOADER  = $(FC)
CCLOADER  = $(CC)
FCLOADFLAGS   = $(FCFLAGS)
CCLOADFLAGS   = $(CCFLAGS)
ARCH  = ar
ARCHFLAGS = cr
RANLIB= ranlib
SCALAPACKLIB  = libscalapack.a
BLASLIB   = /opt/OpenBLAS-0.2.18/libopenblas.a
LAPACKLIB =
LIBS  = $(LAPACKLIB) $(BLASLIB)




Regards,
Mahmood



On Fri, Nov 4, 2016 at 12:25 AM, Sean Ahern  wrote:

> Sounds to me like you're missing a -ldl linker flag.
>
> -Sean
>
> --
> Sean Ahern
> Computational Engineering International
> 919-363-0883
>
> On Thu, Nov 3, 2016 at 3:57 PM, Mahmood Naderan 
> wrote:
>
>> Hi
>> I am building scalapack with mpicc and mpifort, however this is the error
>> I get:
>>
>> mpifort -O3 -o xCbtest blacstest.o btprim.o tools.o Cbt.o
>> ../../libscalapack.a
>> /opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
>> `dlopen_close':
>> dl_dlopen_module.c:(.text+0x29d): undefined reference to `dlclose'
>> /opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
>> `dlopen_lookup':
>> dl_dlopen_module.c:(.text+0x2d0): undefined reference to `dlsym'
>> dl_dlopen_module.c:(.text+0x2fb): undefined reference to `dlerror'
>> /opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
>> `dlopen_open':
>> dl_dlopen_module.c:(.text+0x3ca): undefined reference to `dlopen'
>> dl_dlopen_module.c:(.text+0x431): undefined reference to `dlerror'
>> dl_dlopen_module.c:(.text+0x456): undefined reference to `dlopen'
>> dl_dlopen_module.c:(.text+0x4a9): undefined reference to `dlerror'
>> dl_dlopen_module.c:(.text+0x501): undefined reference to `dlopen'
>> /opt/openmpi-2.0.1/lib/libopen-pal.a(patcher_overwrite_module.o): In
>> function `mca_patcher_overwrite_patch_symbol':
>> patcher_overwrite_module.c:(.text+0x12e): undefined reference to `dlsym'
>> patcher_overwrite_module.c:(.text+0x166): undefined reference to `dlsym'
>> patcher_overwrite_module.c:(.text+0x173): undefined reference to
>> `dlerror'
>> collect2: error: ld returned 1 exit status
>> Makefile:18: recipe for target 'xCbtest' failed
>> make[2]: *** [xCbtest] Error 1
>>
>>
>>
>> As I grep "dlopen", some OMPI binary files match. Any idea about that?
>>
>>
>> Regards,
>> Mahmood
>>
>>
>>
>> ___
>> users mailing list
>> users@lists.open-mpi.org
>> https://rfd.newmexicoconsortium.org/mailman/listinfo/users
>>
>
>
> ___
> users mailing list
> users@lists.open-mpi.org
> https://rfd.newmexicoconsortium.org/mailman/listinfo/users
>
___
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users

Re: [OMPI users] error on dlopen

2016-11-03 Thread Sean Ahern
Sounds to me like you're missing a -ldl linker flag.

-Sean

--
Sean Ahern
Computational Engineering International
919-363-0883

On Thu, Nov 3, 2016 at 3:57 PM, Mahmood Naderan 
wrote:

> Hi
> I am building scalapack with mpicc and mpifort, however this is the error
> I get:
>
> mpifort -O3 -o xCbtest blacstest.o btprim.o tools.o Cbt.o
> ../../libscalapack.a
> /opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
> `dlopen_close':
> dl_dlopen_module.c:(.text+0x29d): undefined reference to `dlclose'
> /opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
> `dlopen_lookup':
> dl_dlopen_module.c:(.text+0x2d0): undefined reference to `dlsym'
> dl_dlopen_module.c:(.text+0x2fb): undefined reference to `dlerror'
> /opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
> `dlopen_open':
> dl_dlopen_module.c:(.text+0x3ca): undefined reference to `dlopen'
> dl_dlopen_module.c:(.text+0x431): undefined reference to `dlerror'
> dl_dlopen_module.c:(.text+0x456): undefined reference to `dlopen'
> dl_dlopen_module.c:(.text+0x4a9): undefined reference to `dlerror'
> dl_dlopen_module.c:(.text+0x501): undefined reference to `dlopen'
> /opt/openmpi-2.0.1/lib/libopen-pal.a(patcher_overwrite_module.o): In
> function `mca_patcher_overwrite_patch_symbol':
> patcher_overwrite_module.c:(.text+0x12e): undefined reference to `dlsym'
> patcher_overwrite_module.c:(.text+0x166): undefined reference to `dlsym'
> patcher_overwrite_module.c:(.text+0x173): undefined reference to `dlerror'
> collect2: error: ld returned 1 exit status
> Makefile:18: recipe for target 'xCbtest' failed
> make[2]: *** [xCbtest] Error 1
>
>
>
> As I grep "dlopen", some OMPI binary files match. Any idea about that?
>
>
> Regards,
> Mahmood
>
>
>
> ___
> users mailing list
> users@lists.open-mpi.org
> https://rfd.newmexicoconsortium.org/mailman/listinfo/users
>
___
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users

[OMPI users] error on dlopen

2016-11-03 Thread Mahmood Naderan
Hi
I am building scalapack with mpicc and mpifort, however this is the error I
get:

mpifort -O3 -o xCbtest blacstest.o btprim.o tools.o Cbt.o
../../libscalapack.a
/opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
`dlopen_close':
dl_dlopen_module.c:(.text+0x29d): undefined reference to `dlclose'
/opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
`dlopen_lookup':
dl_dlopen_module.c:(.text+0x2d0): undefined reference to `dlsym'
dl_dlopen_module.c:(.text+0x2fb): undefined reference to `dlerror'
/opt/openmpi-2.0.1/lib/libopen-pal.a(dl_dlopen_module.o): In function
`dlopen_open':
dl_dlopen_module.c:(.text+0x3ca): undefined reference to `dlopen'
dl_dlopen_module.c:(.text+0x431): undefined reference to `dlerror'
dl_dlopen_module.c:(.text+0x456): undefined reference to `dlopen'
dl_dlopen_module.c:(.text+0x4a9): undefined reference to `dlerror'
dl_dlopen_module.c:(.text+0x501): undefined reference to `dlopen'
/opt/openmpi-2.0.1/lib/libopen-pal.a(patcher_overwrite_module.o): In
function `mca_patcher_overwrite_patch_symbol':
patcher_overwrite_module.c:(.text+0x12e): undefined reference to `dlsym'
patcher_overwrite_module.c:(.text+0x166): undefined reference to `dlsym'
patcher_overwrite_module.c:(.text+0x173): undefined reference to `dlerror'
collect2: error: ld returned 1 exit status
Makefile:18: recipe for target 'xCbtest' failed
make[2]: *** [xCbtest] Error 1



As I grep "dlopen", some OMPI binary files match. Any idea about that?


Regards,
Mahmood
___
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users

Re: [OMPI users] Slurm binding not propagated to MPI jobs

2016-11-03 Thread Andy Riebs

  
  
Getting that support into 2.1 would be terrific -- and might save
  us from having to write some Slurm prolog scripts to effect that.

Thanks Ralph!

On 11/01/2016 11:36 PM,
  r...@open-mpi.org wrote:


  
  Ah crumby!! We already solved this on master, but it cannot be
  backported to the 1.10 series without considerable pain. For some
  reason, the support for it has been removed from the 2.x series as
  well. I’ll try to resolve that issue and get the support
  reinstated there (probably not until 2.1).
  
  
  Can you manage until then? I think the v2 RM’s are
thinking Dec/Jan for 2.1.
  Ralph
  
  
  

  
On Nov 1, 2016, at 11:38 AM, Riebs, Andy  wrote:


  
To
close the thread here… I got the following
information:
 
Looking at SLURM_CPU_BIND is the right idea,
  but there are quite a few more options. It misses
  map_cpu, rank, plus the NUMA-based options:
rank_ldom, map_ldom, and mask_ldom. See the
  srun man pages for documentation.
 
 

  
From: Riebs,
Andy 
Sent: Thursday,
October 27, 2016 1:53 PM
To: users@lists.open-mpi.org
Subject: Re:
[OMPI users] Slurm binding not propagated to MPI
jobs
  

 
Hi Ralph,
I haven't played around in this code,
  so I'll flip the question over to the Slurm list, and
  report back here when I learn anything.
Cheers
  Andy

  On
10/27/2016 01:44 PM, r...@open-mpi.org wrote:


  Sigh
- of course it wouldn’t be simple :-( 
  
 
  
  
All right, let’s suppose we look for
  SLURM_CPU_BIND:
  
  
 
  
  
* if it includes the word “none”,
  then we know the user specified that they don’t
  want us to bind
  
  
 
  
  
* if it includes the word mask_cpu, then
  we have to check the value of that option.
  
  
 
  
  

  * If it is all F’s, then they
didn’t specify a binding and we should do our
thing.


   


  * If it is anything else, then we
assume they _did_ specify a binding, and we
leave it alone

  
  
 
  
  
Would that make sense? Is there anything
  else that could be in that envar which would trip
  us up?
  
  
 
  
  
 

  

  On Oct 27, 2016, at
10:37 AM, Andy Riebs 
wrote:

 

  
Yes, they still
  exist:
$ srun
  --ntasks-per-node=2 -N1 env | grep BIND |
  sort -u
  SLURM_CPU_BIND_LIST=0x
  SLURM_CPU_BIND=quiet,mask_cpu:0x
  SLURM_CPU_BIND_TYPE=mask_cpu:
  SLURM_CPU_BIND_VERBOSE=quiet
Here are the
  relevant Slurm configuration options that
  could conceivably change the behavior from
  system to system:
SelectType 
  = select/cons_res
  

Re: [OMPI users] Disabling MCA component

2016-11-03 Thread Jeff Squyres (jsquyres)
In https://www.mail-archive.com/users@lists.open-mpi.org/msg30229.html, I 
referred to the --enable-mca-no-build configure option.  From "./configure 
--help":

  --enable-mca-no-build=LIST
  Comma-separated list of - pairs
  that will not be built. Example:
  "--enable-mca-no-build=maffinity,btl-portals" will
  disable building all maffinity components and the
  "portals" btl components.


> On Nov 3, 2016, at 6:47 AM, Mahesh Nanavalla  
> wrote:
> 
> Hi all,
> 
> I am compiling openmpi-1.10.3 for arm.
> 
> How can i disable particular MCA component and how can i confirm that.
> 
> Thanks&Regards,
> Mahesh N
> ___
> users mailing list
> users@lists.open-mpi.org
> https://rfd.newmexicoconsortium.org/mailman/listinfo/users


-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to: 
http://www.cisco.com/web/about/doing_business/legal/cri/

___
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users


[OMPI users] Disabling MCA component

2016-11-03 Thread Mahesh Nanavalla
Hi all,

I am compiling openmpi-1.10.3 for arm.

How can i disable particular MCA component and how can i confirm that.

Thanks&Regards,
Mahesh N
___
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users