Re: [OMPI devel] [RFC] Send data from the end of a buffer during pipeline proto

2007-05-18 Thread Gleb Natapov
On Thu, May 17, 2007 at 10:20:35AM -0600, Brian Barrett wrote: > On the other hand, since the MPI standard explicitly says you're not > allowed to call fork() or system() during the MPI application and > sense the network should really cope with this in some way, if it > further complicates t

Re: [OMPI devel] [RFC] Send data from the end of a buffer during pipeline proto

2007-05-18 Thread Gleb Natapov
On Thu, May 17, 2007 at 12:30:51PM -0400, Patrick Geoffray wrote: > Jeff Squyres wrote: > > Moving to devel; this question seems worthwhile to push out to the > > general development community. > > > > I've been coming across an increasing number of customers and other > > random OMPI users wh

Re: [OMPI devel] [RFC] Send data from the end of a buffer during pipeline proto

2007-05-18 Thread Gleb Natapov
On Thu, May 17, 2007 at 02:35:02PM -0400, Patrick Geoffray wrote: > Brian Barrett wrote: > > On the other hand, since the MPI standard explicitly says you're not > > allowed to call fork() or system() during the MPI application and > > Does it ? The MPI spec says that you should not access buf

Re: [OMPI devel] [RFC] Send data from the end of a buffer during pipeline proto

2007-05-18 Thread Gleb Natapov
On Thu, May 17, 2007 at 02:57:22PM -0400, Patrick Geoffray wrote: > gshipman wrote: > >> The fork() problem is due to memory registration aggravated by > >> registration cache. Memory registration in itself is a hack from > >> the OS > >> point of view, and you already know a lot about the variou

[OMPI devel] Change to default xcast mode [RFC]

2007-05-18 Thread Ralph H Castain
For the last several months, we have supported three modes of sending the xcast messages used to release MPI processes from their various stage gates: 1. Direct - message sent directly to each process in a serial fashion 2. Linear - message sent serially to the daemon on each node, which then "fa

Re: [OMPI devel] [devel-core] Change to default xcast mode [RFC]

2007-05-18 Thread Ralph H Castain
On 5/18/07 2:06 PM, "Andrew Friedley" wrote: > Why not use the binomial mode? I assume it is faster? Yes, but it doesn't work right this minute (should be fixed soon), and we would prefer to take a small step first. Linear doesn't require any major code change, while binomial requires we mor

Re: [OMPI devel] [RFC] Send data from the end of a buffer during pipeline proto

2007-05-18 Thread Patrick Geoffray
Hi Gleb, Gleb Natapov wrote: new madvice flag was implemented that allows userspace to mark certain memory to not be copied to a child process. This memory is not mapped in a child at all, no even VMA created for it. In the parent this memory is Ah, that explain your previous mention of segfau