Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-25 Thread Joshua Ladd
rg/mailman/listinfo.cgi/devel > > > or, via email, send a message with subject or body 'help' to > > > devel-requ...@open-mpi.org > > > > > > You can reach the person managing the list at > > > devel-ow...@open-mpi.org

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-24 Thread Jeff Squyres (jsquyres)
message with subject or body 'help' to > > devel-requ...@open-mpi.org > > > > You can reach the person managing the list at > > devel-ow...@open-mpi.org > > > > When replying, please edit your Subject line so it is more specific > > than "Re: Contents of devel digest..." > > > > > > Today&#

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-24 Thread George Bosilca
cribe or unsubscribe via the World Wide Web, visit >> > http://www.open-mpi.org/mailman/listinfo.cgi/devel >> > or, via email, send a message with subject or body 'help' to >> > devel-requ...@open-mpi.org >> > >> > You can reach the person managing the list at >>

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-23 Thread Dave Turner
lease edit your Subject line so it is more specific > > than "Re: Contents of devel digest..." > > > > > > Today's Topics: > > > > 1. Re: OMPI devel] RoCE plus QDR IB tunable parameters > > (George Bosilca) > >2. Re: OM

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-22 Thread Jeff Squyres (jsquyres)
e parameters > (George Bosilca) >2. Re: OMPI devel] RoCE plus QDR IB tunable parameters > (Howard Pritchard) > > > ------ > > Message: 1 > Date: Tue, 10 Feb 2015 20:41:30 -0500 > From:

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-10 Thread Howard Pritchard
HI George, I'd say commit cf377db82 explains the vanishing of the bandwidth metric as well as the mis-labeling of the latency metric. Howard 2015-02-10 18:41 GMT-07:00 George Bosilca : > Somehow one of the most basic information about the capabilities of the > BTLs (bandwidth) disappeared from

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-10 Thread George Bosilca
Somehow one of the most basic information about the capabilities of the BTLs (bandwidth) disappeared from the MCA parameters and the one left (latency) was mislabeled. This mishap not only prevented the communication engine from correctly ordering the BTL for small messages (the latency bound part)

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-09 Thread Dave Turner
Gilles, I tried running with btl_openib_cpc_include rdmacm and saw no change. Let's simplify the problem by forgetting about the channel bonding. If I just do an aggregate test of 16 cores on one machine talking to 16 on a second machine without any settings changed from the default in

Re: [OMPI devel] OMPI devel] RoCE plus QDR IB tunable parameters

2015-02-06 Thread Gilles Gouaillardet
Dave, These settings tell ompi to use native infiniband on the ib qdr port and tcpo/ip on the other port. From the faq, roce is implemented in the openib btl http://www.open-mpi.org/faq/?category=openfabrics#ompi-over-roce Did you use --mca btl_openib_cpc_include rdmacm in your first tests ?