Re: [OMPI devel] allocating sm memory with page alignment

2008-09-08 Thread Lenny Verkhovsky
Actually I will be interested in this discussion. On 9/5/08, Jeff Squyres wrote: > > For the mailing list... > > Note that we moved this conversation to a higher bandwidth (telephone). If > others are interested, please let us know. > > > On Sep 3, 2008, at 1:21 AM, Eugene Loh wrote: > > Jeff S

Re: [OMPI devel] allocating sm memory with page alignment

2008-09-05 Thread Jeff Squyres
For the mailing list... Note that we moved this conversation to a higher bandwidth (telephone). If others are interested, please let us know. On Sep 3, 2008, at 1:21 AM, Eugene Loh wrote: Jeff Squyres wrote: I think even first-touch will make *the whole page* be local to the process t

Re: [OMPI devel] allocating sm memory with page alignment

2008-09-02 Thread Eugene Loh
Jeff Squyres wrote: I think even first-touch will make *the whole page* be local to the process that touches it. Right. So if you have each process take N bytes (where N << page_size), then the 0th process will make that whole page be local; it may be remote for others. I think I'm not

Re: [OMPI devel] allocating sm memory with page alignment

2008-08-31 Thread Jeff Squyres
On Aug 30, 2008, at 10:56 AM, Eugene Loh wrote: There's probably some law of software engineering that applies here. Basically, upon first read, I was filled with bitter resentment against those who had written the code. :^) Then, as I began to feel mastery over its, um, intricacies -- t

Re: [OMPI devel] allocating sm memory with page alignment

2008-08-30 Thread Eugene Loh
Jeff Squyres wrote: On Aug 29, 2008, at 5:52 PM, Eugene Loh wrote: I'm looking at the sm BTL. Excellent! I hope you had a good dash of parmesan with that spaghetti code in there (the sm btl is among the hairiest sections in OMPI...). :-) There's probably some law of software engineer

Re: [OMPI devel] allocating sm memory with page alignment

2008-08-30 Thread Graham, Richard L.
- From: devel-boun...@open-mpi.org To: de...@open-mpi.org Sent: Fri Aug 29 20:52:10 2008 Subject: [OMPI devel] allocating sm memory with page alignment (I'm new to Open MPI.) I'm looking at the sm BTL. In mca_btl_sm_add_procs(), there's a loop over peer processes, with a call to

Re: [OMPI devel] allocating sm memory with page alignment

2008-08-30 Thread Jeff Squyres
On Aug 29, 2008, at 5:52 PM, Eugene Loh wrote: I'm looking at the sm BTL. Excellent! I hope you had a good dash of parmesan with that spaghetti code in there (the sm btl is among the hairiest sections in OMPI...). :-) In mca_btl_sm_add_procs(), there's a loop over peer processes, with

[OMPI devel] allocating sm memory with page alignment

2008-08-29 Thread Eugene Loh
(I'm new to Open MPI.) I'm looking at the sm BTL. In mca_btl_sm_add_procs(), there's a loop over peer processes, with a call to ompi_fifo_init(). That is, one call to ompi_fifo_init() for each connection (sender/receiver pair). In ompi_fifo_init(), there's an allocation of sizeof(ompi_cb_f