Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Bert Wesarg]

On 07/29/2014 08:23 PM, Shamis, Pavel wrote:

Is v1.1 posted somewhere? I don't see it up on the LBNL site.

www.openshmem.org

"Get documentation" - > "Specification"

(For some reason I can not get direct link)


http://bongo.cs.uh.edu/site/sites/default/site_files/openshmem-specification-1.1.pdf

Bert



Pasha


--
Dipl.-Inf. Bert Wesarg
wiss. Mitarbeiter

Technische Universität Dresden
Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
01062 Dresden
Tel.: +49 (351) 463-42451
Fax: +49 (351) 463-37773
E-Mail: bert.wes...@tu-dresden.de



smime.p7s
Description: S/MIME Cryptographic Signature

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Shamis, Pavel]

Is v1.1 posted somewhere? I don't see it up on the LBNL site.

www.openshmem.org

"Get documentation" - > "Specification"

(For some reason I can not get direct link)

Pasha


Josh


On Tue, Jul 29, 2014 at 2:05 PM, Shamis, Pavel 
mailto:sham...@ornl.gov>> wrote:

 Btw, I'm pretty confident, that this Open SHMEM implementation does not
 recognize global or static variables in shared libraries as symmetric
 objects. It is probably wise to note this somewhere to the users.
>>>
>>> I've never got an reply to this query. Any comments on it?
>>
>> it is not supported by OpenSHMEM specification (v1.1 page 3 lines 34-35).
>> (it has never been supported by shmem)
>
> thanks Pasha, that should have crossed my eyes.

Not a problem ! In last month at least three OpenSHMEM users stepped on exactly 
the same issue :)
- Pasha


___
devel mailing list
de...@open-mpi.org
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15318.php

___
devel mailing list
de...@open-mpi.org
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15319.php

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Pritchard Jr., Howard]

Hi Pasha,

It can be done.  Cray Fortran 2008 compiler had to do this to be fully 
compliant with the Fortran 2008
co-array feature.

Howard


-Original Message-
From: devel [mailto:devel-boun...@open-mpi.org] On Behalf Of Shamis, Pavel
Sent: Tuesday, July 29, 2014 12:02 PM
To: Open MPI Developers
Subject: Re: [OMPI devel] SHMEM symmetric objects in shared libraries


then in your main example below do a shmem_long_fadd on my_dso_val.
It won't work unless you've put smarts in the shmem library to go through the 
segments of loaded shared libraries and register them with the same mechanism 
used for the data segment of the executable.


In this case the "smart" part will be pretty complex.

Best,
Pasha


Howard


From: devel 
[mailto:devel-boun...@open-mpi.org<mailto:devel-boun...@open-mpi.org>] On 
Behalf Of Joshua Ladd
Sent: Tuesday, July 29, 2014 10:57 AM
To: Open MPI Developers
Subject: Re: [OMPI devel] SHMEM symmetric objects in shared libraries

Are you claiming that in the following test, the static variable "val" will not 
be seen as a symmetric object?
#include "shmem.h"

int main( int argc, char **argv){
long my_pe, npes, master;

start_pes(0);
my_pe = shmem_my_pe();
npes = shmem_n_pes();

master = npes - 1;

   /* only used on master */
   static long val = 0;


   if(my_pe != master ){
   shmem_long_fadd(&val,1,master);
   }

   shmem_barrier_all();
  return 0;
}
Josh


On Tue, Jul 29, 2014 at 11:27 AM, Bert Wesarg 
mailto:bert.wes...@tu-dresden.de>> wrote:
Hi,

On 05/10/2014 02:46 PM, Bert Wesarg wrote:
Hi,

Btw, I'm pretty confident, that this Open SHMEM implementation does not 
recognize global or static variables in shared libraries as symmetric objects. 
It is probably wise to note this somewhere to the users.

I've never got an reply to this query. Any comments on it?

Bert

Kind regards,
Bert Wesarg

--
Dipl.-Inf. Bert Wesarg
wiss. Mitarbeiter

Technische Universität Dresden
Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
01062 Dresden
Tel.: +49 (351) 463-42451
Fax: +49 (351) 463-37773
E-Mail: bert.wes...@tu-dresden.de<mailto:bert.wes...@tu-dresden.de>


___
devel mailing list
de...@open-mpi.org<mailto:de...@open-mpi.org>
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15305.php


___
devel mailing list
de...@open-mpi.org<mailto:de...@open-mpi.org>
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15313.php

___
devel mailing list
de...@open-mpi.org<mailto:de...@open-mpi.org>
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15314.php

___
devel mailing list
de...@open-mpi.org
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15316.php

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Joshua Ladd]

Pasha,

Is v1.1 posted somewhere? I don't see it up on the LBNL site.

Josh


On Tue, Jul 29, 2014 at 2:05 PM, Shamis, Pavel  wrote:

> 
>  Btw, I'm pretty confident, that this Open SHMEM implementation does
> not
>  recognize global or static variables in shared libraries as symmetric
>  objects. It is probably wise to note this somewhere to the users.
> >>>
> >>> I've never got an reply to this query. Any comments on it?
> >>
> >> it is not supported by OpenSHMEM specification (v1.1 page 3 lines
> 34-35).
> >> (it has never been supported by shmem)
> >
> > thanks Pasha, that should have crossed my eyes.
>
> Not a problem ! In last month at least three OpenSHMEM users stepped on
> exactly the same issue :)
> - Pasha
>
>
> ___
> devel mailing list
> de...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
> Link to this post:
> http://www.open-mpi.org/community/lists/devel/2014/07/15318.php
>

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Shamis, Pavel]

 
 Btw, I'm pretty confident, that this Open SHMEM implementation does not
 recognize global or static variables in shared libraries as symmetric
 objects. It is probably wise to note this somewhere to the users.
>>> 
>>> I've never got an reply to this query. Any comments on it?
>> 
>> it is not supported by OpenSHMEM specification (v1.1 page 3 lines 34-35).
>> (it has never been supported by shmem)
> 
> thanks Pasha, that should have crossed my eyes.

Not a problem ! In last month at least three OpenSHMEM users stepped on exactly 
the same issue :)
- Pasha



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Shamis, Pavel]

then in your main example below do a shmem_long_fadd on my_dso_val.
It won’t work unless you’ve put smarts in the shmem library to go through
the segments of loaded shared libraries and register them with the same
mechanism used for the data segment of the executable.


In this case the "smart" part will be pretty complex.

Best,
Pasha


Howard


From: devel 
[mailto:devel-boun...@open-mpi.org<mailto:devel-boun...@open-mpi.org>] On 
Behalf Of Joshua Ladd
Sent: Tuesday, July 29, 2014 10:57 AM
To: Open MPI Developers
Subject: Re: [OMPI devel] SHMEM symmetric objects in shared libraries

Are you claiming that in the following test, the static variable "val" will not 
be seen as a symmetric object?
#include "shmem.h"

int main( int argc, char **argv){
long my_pe, npes, master;

start_pes(0);
my_pe = shmem_my_pe();
npes = shmem_n_pes();

master = npes - 1;

   /* only used on master */
   static long val = 0;


   if(my_pe != master ){
   shmem_long_fadd(&val,1,master);
   }

   shmem_barrier_all();
  return 0;
}
Josh


On Tue, Jul 29, 2014 at 11:27 AM, Bert Wesarg 
mailto:bert.wes...@tu-dresden.de>> wrote:
Hi,

On 05/10/2014 02:46 PM, Bert Wesarg wrote:
Hi,

Btw, I'm pretty confident, that this Open SHMEM implementation does not
recognize global or static variables in shared libraries as symmetric
objects. It is probably wise to note this somewhere to the users.

I've never got an reply to this query. Any comments on it?

Bert

Kind regards,
Bert Wesarg

--
Dipl.-Inf. Bert Wesarg
wiss. Mitarbeiter

Technische Universität Dresden
Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
01062 Dresden
Tel.: +49 (351) 463-42451
Fax: +49 (351) 463-37773
E-Mail: bert.wes...@tu-dresden.de<mailto:bert.wes...@tu-dresden.de>


___
devel mailing list
de...@open-mpi.org<mailto:de...@open-mpi.org>
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15305.php


___
devel mailing list
de...@open-mpi.org<mailto:de...@open-mpi.org>
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15313.php

___
devel mailing list
de...@open-mpi.org<mailto:de...@open-mpi.org>
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15314.php

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Joshua Ladd]

Gotcha, missed the shared lib part...


On Tue, Jul 29, 2014 at 1:30 PM, Pritchard Jr., Howard 
wrote:

>  Hi Josh,
>
>
>
> No, I think what Bert is talking about is having something like
>
>
>
> foobar.c
> ==
>
> #include “shmem.h”
>
>
>
> long my_dso_val = 0;
>
>
>
> int foobar(void)
>
> {
>
>printf(“Hello from a shared library\n”);
>
> }
>
>
>
> ==
>
>
>
> cc –fPIC –c foobar.c
>
> cc –shared –o libfoobar.so foobar.o
>
> cc –o berts_code berts_code.c –lfoobar
>
>
>
> then in your main example below do a shmem_long_fadd on my_dso_val.
>
> It won’t work unless you’ve put smarts in the shmem library to go through
>
> the segments of loaded shared libraries and register them with the same
>
> mechanism used for the data segment of the executable.
>
>
>
> Howard
>
>
>
>
>
> *From:* devel [mailto:devel-boun...@open-mpi.org] *On Behalf Of *Joshua
> Ladd
> *Sent:* Tuesday, July 29, 2014 10:57 AM
> *To:* Open MPI Developers
> *Subject:* Re: [OMPI devel] SHMEM symmetric objects in shared libraries
>
>
>
> Are you claiming that in the following test, the static variable "val"
> will not be seen as a symmetric object?
>
> #include "shmem.h"
>
>
> int main( int argc, char **argv){
> long my_pe, npes, master;
>
> start_pes(0);
> my_pe = shmem_my_pe();
> npes = shmem_n_pes();
>
> master = npes - 1;
>
>/* only used on master */
>static long val = 0;
>
>
>if(my_pe != master ){
>shmem_long_fadd(&val,1,master);
>}
>
>shmem_barrier_all();
>
>   return 0;
> }
>
> Josh
>
>
>
>
>
> On Tue, Jul 29, 2014 at 11:27 AM, Bert Wesarg 
> wrote:
>
> Hi,
>
> On 05/10/2014 02:46 PM, Bert Wesarg wrote:
>
> Hi,
>
> Btw, I'm pretty confident, that this Open SHMEM implementation does not
> recognize global or static variables in shared libraries as symmetric
> objects. It is probably wise to note this somewhere to the users.
>
>
> I've never got an reply to this query. Any comments on it?
>
> Bert
>
>
> Kind regards,
> Bert Wesarg
>
>
> --
> Dipl.-Inf. Bert Wesarg
> wiss. Mitarbeiter
>
> Technische Universität Dresden
> Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
> 01062 Dresden
> Tel.: +49 (351) 463-42451
> Fax: +49 (351) 463-37773
> E-Mail: bert.wes...@tu-dresden.de
>
>
> ___
> devel mailing list
> de...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
> Link to this post:
> http://www.open-mpi.org/community/lists/devel/2014/07/15305.php
>
>
>
> ___
> devel mailing list
> de...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
> Link to this post:
> http://www.open-mpi.org/community/lists/devel/2014/07/15313.php
>

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Pritchard Jr., Howard]

Hi Josh,

No, I think what Bert is talking about is having something like

foobar.c
==
#include “shmem.h”

long my_dso_val = 0;

int foobar(void)
{
   printf(“Hello from a shared library\n”);
}

==

cc –fPIC –c foobar.c
cc –shared –o libfoobar.so foobar.o
cc –o berts_code berts_code.c –lfoobar

then in your main example below do a shmem_long_fadd on my_dso_val.
It won’t work unless you’ve put smarts in the shmem library to go through
the segments of loaded shared libraries and register them with the same
mechanism used for the data segment of the executable.

Howard


From: devel [mailto:devel-boun...@open-mpi.org] On Behalf Of Joshua Ladd
Sent: Tuesday, July 29, 2014 10:57 AM
To: Open MPI Developers
Subject: Re: [OMPI devel] SHMEM symmetric objects in shared libraries

Are you claiming that in the following test, the static variable "val" will not 
be seen as a symmetric object?
#include "shmem.h"

int main( int argc, char **argv){
long my_pe, npes, master;

start_pes(0);
my_pe = shmem_my_pe();
npes = shmem_n_pes();

master = npes - 1;

   /* only used on master */
   static long val = 0;


   if(my_pe != master ){
   shmem_long_fadd(&val,1,master);
   }

   shmem_barrier_all();
  return 0;
}
Josh


On Tue, Jul 29, 2014 at 11:27 AM, Bert Wesarg 
mailto:bert.wes...@tu-dresden.de>> wrote:
Hi,

On 05/10/2014 02:46 PM, Bert Wesarg wrote:
Hi,

Btw, I'm pretty confident, that this Open SHMEM implementation does not
recognize global or static variables in shared libraries as symmetric
objects. It is probably wise to note this somewhere to the users.

I've never got an reply to this query. Any comments on it?

Bert

Kind regards,
Bert Wesarg

--
Dipl.-Inf. Bert Wesarg
wiss. Mitarbeiter

Technische Universität Dresden
Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
01062 Dresden
Tel.: +49 (351) 463-42451
Fax: +49 (351) 463-37773
E-Mail: bert.wes...@tu-dresden.de<mailto:bert.wes...@tu-dresden.de>


___
devel mailing list
de...@open-mpi.org<mailto:de...@open-mpi.org>
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/07/15305.php

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Bert Wesarg]

On 07/29/2014 06:57 PM, Joshua Ladd wrote:

Are you claiming that in the following test, the static variable "val" will
not be seen as a symmetric object?


No.



#include "shmem.h"

int main( int argc, char **argv){
 long my_pe, npes, master;

 start_pes(0);
 my_pe = shmem_my_pe();
 npes = shmem_n_pes();

 master = npes - 1;

/* only used on master */
static long val = 0;


if(my_pe != master ){
shmem_long_fadd(&val,1,master);
}

shmem_barrier_all();

   return 0;
}

Josh



--
Dipl.-Inf. Bert Wesarg
wiss. Mitarbeiter

Technische Universität Dresden
Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
01062 Dresden
Tel.: +49 (351) 463-42451
Fax: +49 (351) 463-37773
E-Mail: bert.wes...@tu-dresden.de



smime.p7s
Description: S/MIME Cryptographic Signature

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Joshua Ladd]

Are you claiming that in the following test, the static variable "val" will
not be seen as a symmetric object?

#include "shmem.h"

int main( int argc, char **argv){
long my_pe, npes, master;

start_pes(0);
my_pe = shmem_my_pe();
npes = shmem_n_pes();

master = npes - 1;

   /* only used on master */
   static long val = 0;


   if(my_pe != master ){
   shmem_long_fadd(&val,1,master);
   }

   shmem_barrier_all();

  return 0;
}

Josh



On Tue, Jul 29, 2014 at 11:27 AM, Bert Wesarg 
wrote:

> Hi,
>
> On 05/10/2014 02:46 PM, Bert Wesarg wrote:
>
>> Hi,
>>
>> Btw, I'm pretty confident, that this Open SHMEM implementation does not
>> recognize global or static variables in shared libraries as symmetric
>> objects. It is probably wise to note this somewhere to the users.
>>
>
> I've never got an reply to this query. Any comments on it?
>
> Bert
>
>
>> Kind regards,
>> Bert Wesarg
>>
>>
> --
> Dipl.-Inf. Bert Wesarg
> wiss. Mitarbeiter
>
> Technische Universität Dresden
> Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
> 01062 Dresden
> Tel.: +49 (351) 463-42451
> Fax: +49 (351) 463-37773
> E-Mail: bert.wes...@tu-dresden.de
>
>
> ___
> devel mailing list
> de...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
> Link to this post:
> http://www.open-mpi.org/community/lists/devel/2014/07/15305.php
>

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Bert Wesarg]

On 07/29/2014 06:23 PM, Shamis, Pavel wrote:


On 05/10/2014 02:46 PM, Bert Wesarg wrote:

Hi,

Btw, I'm pretty confident, that this Open SHMEM implementation does not
recognize global or static variables in shared libraries as symmetric
objects. It is probably wise to note this somewhere to the users.


I've never got an reply to this query. Any comments on it?


it is not supported by OpenSHMEM specification (v1.1 page 3 lines 34-35).
(it has never been supported by shmem)


thanks Pasha, that should have crossed my eyes.

Bert



Best,
Pasha


--
Dipl.-Inf. Bert Wesarg
wiss. Mitarbeiter

Technische Universität Dresden
Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
01062 Dresden
Tel.: +49 (351) 463-42451
Fax: +49 (351) 463-37773
E-Mail: bert.wes...@tu-dresden.de



smime.p7s
Description: S/MIME Cryptographic Signature

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Shamis, Pavel]

> 
> On 05/10/2014 02:46 PM, Bert Wesarg wrote:
>> Hi,
>> 
>> Btw, I'm pretty confident, that this Open SHMEM implementation does not
>> recognize global or static variables in shared libraries as symmetric
>> objects. It is probably wise to note this somewhere to the users.
> 
> I've never got an reply to this query. Any comments on it?

it is not supported by OpenSHMEM specification (v1.1 page 3 lines 34-35). 
(it has never been supported by shmem)

Best,
Pasha



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [OMPI devel] SHMEM symmetric objects in shared libraries

[Bert Wesarg]

Hi,

On 05/10/2014 02:46 PM, Bert Wesarg wrote:

Hi,

Btw, I'm pretty confident, that this Open SHMEM implementation does not
recognize global or static variables in shared libraries as symmetric
objects. It is probably wise to note this somewhere to the users.


I've never got an reply to this query. Any comments on it?

Bert



Kind regards,
Bert Wesarg



--
Dipl.-Inf. Bert Wesarg
wiss. Mitarbeiter

Technische Universität Dresden
Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)
01062 Dresden
Tel.: +49 (351) 463-42451
Fax: +49 (351) 463-37773
E-Mail: bert.wes...@tu-dresden.de



smime.p7s
Description: S/MIME Cryptographic Signature